00000001:02000400:0.0F:1787387798.447451:0:3300:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787387818.080994:0:3521:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787387819.708252:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 855 MB/s 00000001:01000000:0.0:1787387819.959023:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 394 MB/s 00000001:01000000:0.0:1787387820.209407:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3711 MB/s 00000020:02000000:3.0:1787387821.105654:0:3613:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_110_g2f98931 00000400:02000000:0.0:1787387821.855160:0:3628:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.152@tcp [8/256/0/180] 00008000:02000000:2.0:1787387826.460745:0:3778:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787387891.899275:0:5747:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787387904.994920:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387904.994926:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787387904.994928:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787387904.995034:0:6497:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000000c92d994 00000080:02000400:2.0:1787387904.995045:0:6497:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787387905.004081:0:6497:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787387905.004095:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787387905.004131:0:6497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002163a79f) 00000020:00000080:2.0:1787387905.004241:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787387905.076088:0:6497:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787387905.076189:0:6497:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787387905.109456:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787387905.109675:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787387905.109713:0:6497:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787387905.109723:0:6497:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1811597 00000020:01000004:2.0:1787387905.109730:0:6497:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787387905.109735:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787387905.109739:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c92d994 from MGS 00000020:01000004:2.0:1787387905.109743:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787387905.109751:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006f7528dc) 00000020:00000080:2.0:1787387905.109760:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787387905.109823:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c92d994 from MGS, refs=2 00080000:01000000:2.0:1787387905.109827:0:6497:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787387905.109832:0:6497:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b18115a5 00000100:00100000:2.0:1787387905.109918:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787387905.110026:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787387905.110031:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787387905.120799:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787387905.120893:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787387905.122630:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387905.122854:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787387905.122860:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787387905.124224:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787387905.124234:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787387905.125318:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787387905.125329:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1787387905.128064:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387905.128083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387905.128085:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387905.129109:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387905.129113:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387905.129115:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387905.131348:0:6497:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787387905.136635:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787387905.381601:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2615 MB/s 00000001:01000000:3.0:1787387905.630778:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3879 MB/s 00000001:01000000:2.0:1787387905.887938:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 591 MB/s 00000001:01000000:1.0:1787387906.138942:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 426 MB/s 00080000:10000000:0.0:1787387906.151252:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:1.0:1787387906.184094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787387906.189847:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787387906.206042:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787387906.206935:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787387906.207014:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787387906.208004:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787387906.208045:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787387906.208644:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387906.211107:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787387906.211120:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787387906.228242:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787387906.228263:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787387906.228799:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787387906.228807:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787387906.234158:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787387906.234189:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.152@tcp' 00000020:01000004:3.0:1787387906.234191:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787387906.234270:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.152@tcp (typ=mgc) 00000020:00000080:3.0:1787387906.234303:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.152@tcp (00000000a96fc2d3) 00000020:00000080:3.0:1787387906.234322:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787387906.234463:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fad319ce@MGC192.168.204.152@tcp: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787387906.234653:0:6497:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.152@tcp-0 is initialized 00000040:01000000:3.0:1787387906.234660:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787387906.235500:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787387906.235534:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.152@tcp (uuid 29e41aeb-8af0-4a54-a54e-7e42c8606c3d) 00000020:00000080:1.0:1787387906.235550:0:6497:0:(genops.c:1406:class_connect()) connect: client 29e41aeb-8af0-4a54-a54e-7e42c8606c3d, cookie 0x5cb77467b18115b3 00000100:00080000:1.0:1787387906.235559:0:6497:0:(import.c:510:import_select_connection()) MGC192.168.204.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387906.235563:0:6497:0:(import.c:624:import_select_connection()) MGC192.168.204.152@tcp: import 00000000fad319ce using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787387906.235602:0:6497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000091da2d90 x1874211971793024/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787387906.235621:0:6497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS 00000020:01000004:1.0:1787387906.235637:0:6497:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787387906.235642:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787387906.235656:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f92aafea) 00000020:00000080:1.0:1787387906.235666:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787387906.236391:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091da2d90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971793024:0@lo:250: 00000100:00100000:2.0:1787387906.236485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387906.236571:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793024 00000100:00100000:2.0:1787387906.236578:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793024 00000100:00100000:2.0:1787387906.236609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387906.236615:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d95fec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1874211971793024:12345-0@lo:250: 00010000:00080000:2.0:1787387906.236636:0:6513:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 29e41aeb-8af0-4a54-a54e-7e42c8606c3d@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1787387906.236658:0:6513:0:(genops.c:1406:class_connect()) connect: client 29e41aeb-8af0-4a54-a54e-7e42c8606c3d, cookie 0x5cb77467b18115c1 00000100:00080000:2.0:1787387906.236788:0:6513:0:(import.c:65:import_set_state_nolock()) 000000003b7c5a50 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387906.236840:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d95fec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:3643:x1874211971793024:12345-0@lo:250: Request processed in 224us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.236847:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387906.236888:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787387906.241170:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1787387906.241182:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787387906.241187:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787387906.241191:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000fad319ce MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787387906.241195:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787387906.241200:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787387906.241210:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091da2d90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971793024:0@lo:250: 00000100:00080000:0.0:1787387906.244291:0:6516:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1787387906.260872:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387906.261057:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787387906.261063:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787387906.283282:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787387906.283307:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787387906.293165:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387906.293181:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787387906.294633:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387906.294842:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787387906.294848:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787387906.296009:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787387906.296019:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787387906.358859:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387906.359049:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787387906.359057:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787387906.360306:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787387906.360318:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787387906.373822:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387906.373992:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787387906.373998:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787387906.375503:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787387906.375526:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787387906.377324:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387906.377496:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787387906.377501:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787387906.390356:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787387906.390378:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787387906.391083:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387906.391258:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787387906.391263:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787387906.391996:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787387906.392004:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787387906.441931:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387906.442189:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787387906.442203:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787387906.450949:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787387906.450975:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787387906.451950:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387906.451961:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787387906.453018:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787387906.453052:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787387906.453059:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787387906.453189:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787387906.453228:0:6497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.152@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787387906.453233:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787387906.453235:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787387906.453236:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387906.453237:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387906.453238:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387906.453240:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387906.453241:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387906.453243:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787387906.453244:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387906.453245:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387906.453247:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387906.453248:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387906.453251:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787387906.453253:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387906.453254:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787387906.453255:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387906.453262:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387906.453262:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387906.453263:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387906.453264:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387906.453265:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787387906.453265:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387906.453266:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387906.453267:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387906.453268:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387906.453306:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787387906.453336:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793152:0@lo:253: 00000100:00100000:1.0:1787387906.453416:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.453469:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 00000000891037aa going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.453711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793152 00000100:00100000:3.0:1787387906.453719:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793152 00000100:00100000:3.0:1787387906.453761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387906.453767:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002db9934d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6497:x1874211971793152:12345-0@lo:253: 20000000:01000000:3.0:1787387906.453815:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787387906.453818:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787387906.454821:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787387906.454870:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787387906.455130:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387906.457810:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787387906.462451:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787387906.462460:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787387906.462470:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787387906.462474:0:6515:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787387906.462487:0:6515:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787387906.462729:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387906.462915:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787387906.462936:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387906.462957:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787387906.462973:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787387906.463005:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787387906.463063:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787387906.463071:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787387906.463084:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787387906.463090:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787387906.463100:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787387906.463105:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787387906.463116:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787387906.463131:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787387906.463160:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787387906.463165:0:6515:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787387906.463172:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387906.463639:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787387906.463651:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787387906.463668:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787387906.463733:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787387906.463750:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787387906.463759:0:6515:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787387906.463787:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787387906.463795:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787387906.463808:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787387906.463823:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787387906.463835:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787387906.463843:0:6515:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787387906.463868:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787387906.463877:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787387906.463891:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787387906.463923:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787387906.463979:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787387906.464007:0:6515:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787387906.464014:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787387906.464468:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787387906.466407:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787387906.466442:0:6515:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.152@tcp for mdt 20000000:01000000:3.0:1787387906.466445:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:3.0:1787387906.466460:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787387906.466466:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787387906.466480:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787387906.466485:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:3.0:1787387906.466496:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787387906.466502:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787387906.466511:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787387906.466522:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787387906.466548:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787387906.466551:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787387906.466554:0:6515:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787387906.466621:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787387906.466624:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787387906.468189:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787387906.468468:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787387906.468497:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787387906.468514:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787387906.468527:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787387906.468529:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787387906.470453:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787387906.470748:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787387906.470779:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787387906.470795:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787387906.470813:0:6515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387906.470825:0:6515:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787387906.470831:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787387906.470834:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787387906.470840:0:6515:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787387906.470847:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787387906.485792:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787387906.486144:0:6515:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787387906.507805:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787387906.507904:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787387906.507927:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787387906.507952:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787387906.507976:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.507993:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508014:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508021:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508027:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508034:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508056:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df317696 already unused, calling callback (00000000b6564a3e) 00010000:00010000:2.0:1787387906.508060:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508067:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508079:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508086:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.508092:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df317696/0x5cb77467b18115c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387906.508109:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787387906.519447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002db9934d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6497:x1874211971793152:12345-0@lo:253: Request processed in 65668us (66020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.519464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387906.521096:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793152:0@lo:253: 10000000:01000000:1.0:1787387906.521116:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787387906.521120:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387906.521122:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787387906.521123:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387906.521124:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787387906.521125:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387906.521127:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387906.521128:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387906.521129:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787387906.521131:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787387906.521132:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387906.521133:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787387906.521155:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c92d994 from lustre-MDT0000 10000000:01000000:1.0:1787387906.521214:0:6497:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787387906.521218:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787387906.521222:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9273d0f44d40 10000000:01000000:1.0:1787387906.521227:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387906.521235:0:6497:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9273d0f44d40 from 1 10000000:01000000:1.0:1787387906.521237:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787387906.521290:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.521315:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.521323:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387906.521341:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793280:0@lo:101: 00000100:00100000:1.0:1787387906.521395:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.521458:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070211b1f going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.522085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793280 00000100:00100000:2.0:1787387906.522094:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793280 00000100:00100000:2.0:1787387906.522142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387906.522152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020f3b12f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6497:x1874211971793280:12345-0@lo:101: 00010000:00010000:2.0:1787387906.522166:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387906.522181:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18115cf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.522207:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18115cf expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.522227:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18115cf expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.522236:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df317696, rc 0) 00000100:00100000:2.0:1787387906.522304:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020f3b12f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6497:x1874211971793280:12345-0@lo:101: Request processed in 153us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.522311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387906.522411:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793280:0@lo:101: 00010000:00010000:1.0:1787387906.522426:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.522435:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387906.522506:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793408:0@lo:501: 00000100:00100000:1.0:1787387906.522536:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.522569:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070211b1f going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.522628:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793408 00000100:00100000:2.0:1787387906.522633:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793408 00000100:00100000:2.0:1787387906.522666:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387906.522673:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7883d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6497:x1874211971793408:12345-0@lo:501: 00000100:00100000:2.0:1787387906.522786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7883d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6497:x1874211971793408:12345-0@lo:501: Request processed in 113us (250us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387906.522793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387906.523131:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793408:0@lo:501: 10000000:01000000:1.0:1787387906.523158:0:6497:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787387906.523179:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.523187:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387906.523208:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9273c9714000 10000000:01000000:1.0:1787387906.523212:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387906.523216:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9273c9714000 10000000:01000000:1.0:1787387906.523218:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787387906.523221:0:6497:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9273c9714000 from 1 10000000:01000000:1.0:1787387906.523223:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787387906.523244:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.523252:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.523259:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387906.523281:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793536:0@lo:101: 00000100:00100000:1.0:1787387906.523313:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.523344:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070211b1f going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.524887:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793536 00000100:00100000:2.0:1787387906.525079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793536 00000100:00100000:2.0:1787387906.525198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387906.525207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072742745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6497:x1874211971793536:12345-0@lo:101: 00010000:00010000:2.0:1787387906.525223:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387906.525241:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d58bce6b/0x5cb77467b18115e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18115dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.525280:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d58bce6b/0x5cb77467b18115e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18115dd expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.525291:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d58bce6b/0x5cb77467b18115e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18115dd expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.525319:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d58bce6b, rc 0) 00000100:00100000:2.0:1787387906.525389:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072742745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:6497:x1874211971793536:12345-0@lo:101: Request processed in 184us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.525397:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387906.525490:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793536:0@lo:101: 00010000:00010000:1.0:1787387906.525508:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.525516:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387906.525534:0:6497:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787387906.525553:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.525571:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000000cd819ef/0x5cb77467b18115dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387906.525579:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787387906.525583:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387906.525589:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9273c9714000 10000000:01000000:1.0:1787387906.525592:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787387906.525595:0:6497:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787387906.525598:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387906.525624:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.525631:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.525638:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387906.525656:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793664:0@lo:101: 00000100:00100000:1.0:1787387906.525752:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.531661:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793664 00000100:00100000:3.0:1787387906.531699:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793664 00000100:00100000:1.0:1787387906.531716:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070211b1f going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.531772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387906.531781:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059554f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:6497:x1874211971793664:12345-0@lo:101: 00010000:00010000:3.0:1787387906.531799:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387906.531819:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18115eb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.531847:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18115eb expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.531857:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18115eb expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.531866:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042a545bd, rc 0) 00000100:00100000:3.0:1787387906.531974:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059554f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+8:6497:x1874211971793664:12345-0@lo:101: Request processed in 194us (6222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387906.531981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387906.532085:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793664:0@lo:101: 00010000:00010000:1.0:1787387906.532101:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.532111:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387906.532200:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793792:0@lo:501: 00000100:00100000:1.0:1787387906.532235:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.532258:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070211b1f going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.532323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793792 00000100:00100000:3.0:1787387906.532328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793792 00000100:00100000:3.0:1787387906.532345:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387906.532350:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da09d44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+8:6497:x1874211971793792:12345-0@lo:501: 00000100:00100000:3.0:1787387906.532482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da09d44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6497:x1874211971793792:12345-0@lo:501: Request processed in 132us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387906.532496:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387906.532568:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793792:0@lo:501: 00000100:00100000:1.0:1787387906.532606:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793920:0@lo:503: 00000100:00100000:1.0:1787387906.532642:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.532662:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070211b1f going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.532728:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971793920 00000100:00100000:3.0:1787387906.532732:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971793920 00000100:00100000:3.0:1787387906.532748:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387906.532753:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e0ea26f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6497:x1874211971793920:12345-0@lo:503: 00000100:00100000:3.0:1787387906.532834:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e0ea26f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6497:x1874211971793920:12345-0@lo:503: Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387906.532840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387906.532922:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971793920:0@lo:503: 00000100:00100000:1.0:1787387906.533598:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6542:1874211971794048:0@lo:502: 00000100:00100000:1.0:1787387906.533641:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387906.533848:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055ce632f going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.533886:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794048 00000100:00100000:3.0:1787387906.533891:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794048 00000100:00100000:3.0:1787387906.534020:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387906.534028:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000982eea45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6542:x1874211971794048:12345-0@lo:502: 00000100:00100000:3.0:1787387906.534184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000982eea45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6542:x1874211971794048:12345-0@lo:502: Request processed in 157us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387906.534192:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787387906.534951:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6542:1874211971794048:0@lo:502: 00000020:01000000:1.0:1787387906.534983:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387906.534996:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387906.534998:0:6542:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787387906.535003:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787387906.535006:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387906.535020:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006e4e2a58) 00000020:00000080:1.0:1787387906.535038:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787387906.535045:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787387906.535130:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787387906.535137:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1811600 00000020:00000080:1.0:1787387906.535340:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787387906.535344:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387906.535347:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387906.535348:0:6542:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787387906.535350:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387906.535359:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387906.535360:0:6542:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787387906.535363:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387906.535369:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002b6906e9) 00000020:00000080:1.0:1787387906.535379:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787387906.535384:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787387906.535385:0:6542:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787387906.535388:0:6542:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787387906.535394:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787387906.535460:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c92d994 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787387906.535474:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004cf106ce) 00000020:00000080:1.0:1787387906.535481:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787387906.535554:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787387906.535560:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1811615 00000020:00000080:1.0:1787387906.535665:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787387906.535672:0:6542:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787387906.535676:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5cb77467b181161c 00080000:01000000:1.0:1787387906.535704:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787387906.535707:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1811623 00080000:10000000:1.0:1787387906.536296:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787387906.536458:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787387906.545584:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787387906.677844:0:6542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787387906.678196:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787387906.685470:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787387906.685959:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787387906.693382:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007147a750) 00000020:00000080:2.0:1787387906.693405:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787387906.693495:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787387906.693503:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1811631 00000020:00000080:2.0:1787387906.695569:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787387906.696568:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787387906.722955:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787387906.728625:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787387906.739341:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1787387906.745399:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1787387906.751971:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1787387906.760325:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5cb77467b1811638 00000020:00000080:0.0:1787387906.764625:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787387906.764639:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387906.764645:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387906.764647:0:6542:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787387906.764650:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387906.764654:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387906.764655:0:6542:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387906.764659:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387906.764660:0:6542:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787387906.764671:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387906.764674:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387906.764675:0:6542:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787387906.764694:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387906.764700:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387906.764701:0:6542:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787387906.764705:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787387906.764777:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787387906.764848:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000000437283 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6542:1874211971794176:0@lo:502: 00000100:00100000:0.0:1787387906.764940:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387906.765248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794176 00000100:00100000:0.0:1787387906.765256:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794176 00000100:00100000:0.0:1787387906.765363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387906.765372:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000421eaa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6542:x1874211971794176:12345-0@lo:502: 00000100:00100000:0.0:1787387906.765494:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000421eaa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6542:x1874211971794176:12345-0@lo:502: Request processed in 123us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387906.765502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387906.765795:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000009339d9a1 going to sleep for 11 seconds 00000100:00100000:0.0:1787387906.765819:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000000437283 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6542:1874211971794176:0@lo:502: 00000020:01000000:0.0:1787387906.765845:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387906.765850:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387906.765852:0:6542:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787387906.765855:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787387906.766019:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787387906.766040:0:6497:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787387906.766058:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.766069:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387906.766089:0:6497:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c9714000 from 1 10000000:01000000:3.0:1787387906.766092:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387906.766133:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.766141:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.766150:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387906.766165:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794304:0@lo:101: 00000100:00100000:3.0:1787387906.766204:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387906.766540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794304 00000100:00100000:2.0:1787387906.766547:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794304 00000100:00100000:2.0:1787387906.766590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387906.766597:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbfe1ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6497:x1874211971794304:12345-0@lo:101: 00010000:00010000:2.0:1787387906.766608:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387906.766623:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181163f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.766645:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181163f expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.766654:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181163f expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.766664:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070fcc81e, rc 0) 00000100:00100000:2.0:1787387906.766719:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbfe1ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:6497:x1874211971794304:12345-0@lo:101: Request processed in 122us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.766747:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387906.767101:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dad8294 going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.767132:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794304:0@lo:101: 00010000:00010000:3.0:1787387906.767147:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.767156:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387906.768132:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794432:0@lo:256: 00000100:00100000:3.0:1787387906.768190:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.768224:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dad8294 going to sleep for 11 seconds 00000100:00100000:0.0:1787387906.768293:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794432 00000100:00100000:0.0:1787387906.768301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794432 00000100:00100000:0.0:1787387906.768389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387906.768398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006aec4773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:6497:x1874211971794432:12345-0@lo:256: 20000000:01000000:0.0:1787387906.768416:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787387906.768422:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787387906.768506:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006aec4773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:6497:x1874211971794432:12345-0@lo:256: Request processed in 109us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387906.768514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387906.768582:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794432:0@lo:256: 10000000:01000000:3.0:1787387906.769353:0:6497:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787387906.769387:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.769408:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387906.769417:0:6497:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c9714000 from 1 10000000:01000000:3.0:1787387906.769421:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387906.769448:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.769455:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.769463:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387906.769476:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794560:0@lo:101: 00000100:00100000:3.0:1787387906.769514:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.770292:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dad8294 going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.770386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794560 00000100:00100000:2.0:1787387906.770394:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794560 00000100:00100000:2.0:1787387906.770430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387906.770438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd46ad6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:6497:x1874211971794560:12345-0@lo:101: 00010000:00010000:2.0:1787387906.770451:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387906.770468:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181164d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.770493:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181164d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.770503:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181164d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.770512:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009308a831, rc 0) 00000100:00100000:2.0:1787387906.770564:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd46ad6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6497:x1874211971794560:12345-0@lo:101: Request processed in 127us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.770571:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387906.770654:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794560:0@lo:101: 00010000:00010000:3.0:1787387906.770666:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.770674:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387906.770941:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794688:0@lo:501: 00000100:00100000:3.0:1787387906.771156:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.771180:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dad8294 going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.771241:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794688 00000100:00100000:2.0:1787387906.771246:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794688 00000100:00100000:2.0:1787387906.771278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387906.771284:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003328f103 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6497:x1874211971794688:12345-0@lo:501: 00000100:00100000:2.0:1787387906.771463:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003328f103 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6497:x1874211971794688:12345-0@lo:501: Request processed in 179us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.771470:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387906.772179:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794688:0@lo:501: 00000100:00100000:3.0:1787387906.772228:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794816:0@lo:503: 00000100:00100000:3.0:1787387906.772299:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.772331:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dad8294 going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.772419:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794816 00000100:00100000:2.0:1787387906.772425:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794816 00000100:00100000:2.0:1787387906.772456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387906.772462:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dbf739b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6497:x1874211971794816:12345-0@lo:503: 00000040:00080000:2.0:1787387906.772502:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387906.772546:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dbf739b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6497:x1874211971794816:12345-0@lo:503: Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.772553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387906.772598:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bc31370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794816:0@lo:503: 00000040:00080000:2.0:1787387906.773567:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787387906.773746:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787387906.773775:0:6497:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387906.773796:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.773807:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387906.773855:0:6497:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787387906.773858:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9273c9714000 10000000:01000000:3.0:1787387906.773861:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9273c9714000 10000000:01000000:3.0:1787387906.773865:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787387906.773870:0:6497:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273c9714000 from 1 10000000:01000000:3.0:1787387906.773874:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787387906.773901:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.773908:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.773917:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387906.773932:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794944:0@lo:101: 00000100:00100000:3.0:1787387906.773985:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.774020:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f16fa960 going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.774180:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971794944 00000100:00100000:2.0:1787387906.774186:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971794944 00000100:00100000:2.0:1787387906.774214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387906.774221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051bda3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6497:x1874211971794944:12345-0@lo:101: 00010000:00010000:2.0:1787387906.774233:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387906.774244:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181165b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.774274:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181165b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.774285:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181165b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.774292:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a81b547, rc 0) 00000100:00100000:2.0:1787387906.774335:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051bda3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971794944:12345-0@lo:101: Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.774341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387906.774576:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971794944:0@lo:101: 00010000:00010000:3.0:1787387906.774588:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.774596:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387906.774645:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971795072:0@lo:501: 00000100:00100000:3.0:1787387906.774672:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.774714:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f16fa960 going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.774914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795072 00000100:00100000:2.0:1787387906.774919:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795072 00000100:00100000:2.0:1787387906.774955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387906.774972:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001da0e334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971795072:12345-0@lo:501: 00000100:00100000:2.0:1787387906.775082:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001da0e334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971795072:12345-0@lo:501: Request processed in 111us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.775088:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387906.775238:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971795072:0@lo:501: 00000100:00100000:3.0:1787387906.775277:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971795200:0@lo:503: 00000100:00100000:3.0:1787387906.775316:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.775343:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f16fa960 going to sleep for 11 seconds 00000100:00100000:2.0:1787387906.775391:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795200 00000100:00100000:2.0:1787387906.775395:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795200 00000100:00100000:2.0:1787387906.775456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787387906.775463:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059172c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971795200:12345-0@lo:503: 00000100:00100000:2.0:1787387906.775543:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059172c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971795200:12345-0@lo:503: Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.775549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387906.775616:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971795200:0@lo:503: 00000100:00100000:0.0:1787387906.776260:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000000437283 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6547:1874211971795328:0@lo:502: 00000100:00100000:0.0:1787387906.776314:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387906.776344:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 00000000989f329e going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.776386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795328 00000100:00100000:3.0:1787387906.776391:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795328 00000100:00100000:3.0:1787387906.776415:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387906.776420:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082bd05fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6547:x1874211971795328:12345-0@lo:502: 00000100:00100000:3.0:1787387906.776510:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082bd05fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6547:x1874211971795328:12345-0@lo:502: Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387906.776518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387906.776590:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000000437283 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6547:1874211971795328:0@lo:502: 00000020:01000004:0.0:1787387906.776646:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787387906.776671:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006e136d40) 00000020:00000080:0.0:1787387906.776725:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787387906.777100:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c92d994 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787387906.777105:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000c92d994 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787387906.777107:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000c92d994 4 00010000:00080000:0.0:1787387906.777147:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010937ae4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:1.0:1787387906.780285:0:6547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787387906.780381:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787387906.780426:0:6547:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787387906.780437:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5cb77467b1811670 00000100:00080000:1.0:1787387906.780447:0:6547:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387906.780451:0:6547:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000010937ae4 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787387906.780485:0:6547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c73472b x1874211971795456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387906.780548:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971795456:0@lo:38: 00000100:00100000:0.0:1787387906.780619:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.780652:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795456 00000100:00100000:3.0:1787387906.780660:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795456 00000100:00080000:1.0:1787387906.780699:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787387906.780712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387906.780719:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000437283 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971795456:12345-0@lo:38: 00000100:00100000:1.0:1787387906.781055:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6547:1874211971795584:0@lo:502: 00000100:00100000:1.0:1787387906.781106:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.781126:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d9d1ec64 going to sleep for 11 seconds 00000100:00100000:3.0:1787387906.781368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000437283 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971795456:12345-0@lo:38: Request processed in 648us (748us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787387906.781372:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787387906.781376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787387906.781380:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000010937ae4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787387906.781384:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787387906.781386:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c73472b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971795456:0@lo:38: 00000100:00100000:3.0:1787387906.781402:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795584 00000100:00100000:3.0:1787387906.781406:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795584 00000100:00100000:3.0:1787387906.781444:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387906.781452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a26b454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6547:x1874211971795584:12345-0@lo:502: 00000100:00100000:3.0:1787387906.781937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a26b454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6547:x1874211971795584:12345-0@lo:502: Request processed in 484us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387906.781945:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787387906.782056:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6547:1874211971795584:0@lo:502: 00000040:00080000:1.0:1787387906.782080:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787387906.786093:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787387906.786132:0:6497:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387906.786195:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387906.786207:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787387906.786281:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787387906.786283:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387906.786285:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387906.786286:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387906.786287:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387906.786288:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387906.786289:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387906.786291:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387906.786292:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387906.786294:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387906.786295:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387906.786296:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787387906.786300:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787387906.786302:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787387906.786309:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387906.786310:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387906.786311:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387906.786311:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387906.786312:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387906.786313:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387906.786314:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387906.786315:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387906.786316:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387906.786317:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387906.786317:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787387906.786343:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787387906.786360:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971795712:0@lo:253: 00000100:00100000:3.0:1787387906.786441:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387906.786488:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e1414a48 going to sleep for 11 seconds 00000100:00100000:0.0:1787387906.786548:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795712 00000100:00100000:0.0:1787387906.786557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795712 00000100:00100000:0.0:1787387906.786614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387906.786622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025421c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971795712:12345-0@lo:253: 20000000:01000000:0.0:1787387906.786651:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787387906.786665:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787387906.800655:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787387906.801063:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787387906.801627:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787387906.801634:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787387906.801664:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.801722:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.802203:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.802247:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.802261:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387906.802289:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971795840:0@lo:104: 00000100:00100000:1.0:1787387906.802359:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387906.802428:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032e42297 going to sleep for 11 seconds 00000100:00100000:0.0:1787387906.802558:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025421c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6497:x1874211971795712:12345-0@lo:253: Request processed in 15936us (16116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387906.802569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387906.802663:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6497:1874211971795712:0@lo:253: 10000000:01000000:3.0:1787387906.802675:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787387906.802709:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787387906.802711:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387906.802712:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387906.802713:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387906.802714:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387906.802715:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387906.802717:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387906.802718:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387906.802719:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387906.802720:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387906.802722:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387906.802723:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787387906.802730:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795840 00000100:00100000:2.0:1787387906.802737:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795840 00000020:02000000:3.0:1787387906.802745:0:6497:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787387906.802784:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387906.802792:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000828471fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971795840:12345-0@lo:104: 00010000:00010000:2.0:1787387906.802804:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.802854:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387906.802859:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000828471fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971795840:12345-0@lo:104: Request processed in 69us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.802866:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787387906.803885:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387906.803894:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387906.803903:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af9f7519 already unused, calling callback (00000000695490a4) 10000000:00010000:0.0:1787387906.803906:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387906.803915:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387906.803921:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387906.803926:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387906.804042:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387906.804049:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387906.804071:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387906.804077:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 00000000af9f7519/0x5cb77467b181163f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811646 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387906.804104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387906.804106:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387906.804121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387906.804874:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971795840:0@lo:104: 00010000:00010000:1.0:1787387906.804903:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387906.805210:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004cc88b95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971795968:0@lo:103: 00000100:00100000:0.0:1787387906.805277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387906.805512:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971795968 00000100:00100000:2.0:1787387906.805520:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971795968 00010000:00010000:2.0:1787387906.805547:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387906.805585:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387906.805601:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018ce9048 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3645:x1874211971795968:12345-0@lo:103: 00010000:00010000:2.0:1787387906.805614:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387906.805620:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805630:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805645:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070fcc81e/0x5cb77467b1811646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b181163f expref: 12 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805660:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805668:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387906.805898:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004265287s 00010000:00010000:2.0:1787387906.805903:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805910:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805916:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805922:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805928:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b13be6a6 already unused, calling callback (00000000b6564a3e) 00010000:00010000:2.0:1787387906.805936:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805943:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805963:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387906.805974:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387906.806034:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.806052:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387906.806058:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b13be6a6/0x5cb77467b1811677 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387906.806220:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018ce9048 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:3645:x1874211971795968:12345-0@lo:103: Request processed in 620us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387906.806227:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387906.806314:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004cc88b95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971795968:0@lo:103: 00080000:10000000:3.0:1787387906.811550:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1787387906.812430:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787387906.814796:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1787387906.815132:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787387906.815322:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1787387906.815472:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787387906.816750:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1787387906.817191:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787387906.817401:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787387906.817575:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787387906.818206:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787387906.818413:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787387906.822230:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787387906.833227:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787387906.833457:0:6552:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787387906.833462:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787387906.833517:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787387906.835723:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787387906.836106:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787387906.836568:0:6497:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787387906.836577:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787387906.836762:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387906.838067:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787387906.840751:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787387906.840898:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787387906.841166:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787387906.841428:0:6497:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1787387906.843058:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1787387906.848272:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787387906.848839:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787387906.849464:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787387906.854745:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787387906.855120:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787387906.855319:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787387906.855471:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787387906.855961:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787387906.856232:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787387906.856392:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787387906.856649:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787387906.856950:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787387906.857236:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787387906.857387:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000040:00080000:1.0:1787387906.857524:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787387906.857618:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787387906.857623:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1787387906.857731:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787387906.860336:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787387906.862279:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787387906.862526:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787387906.862670:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787387906.865646:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787387906.870318:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787387906.870736:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787387906.870891:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787387906.872167:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787387906.872365:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787387906.872524:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787387906.872670:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787387906.873304:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787387906.873456:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787387906.873614:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787387906.874111:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787387906.874252:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787387906.875372:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787387906.881081:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787387906.881124:0:6497:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0cc1c93988 00100000:10000000:3.0:1787387906.881132:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787387906.888139:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787387906.888158:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787387906.888176:0:6497:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787387906.888196:0:6497:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787387906.889014:0:6497:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387906.889196:0:6497:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787387907.208102:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387908.235581:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387909.258110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387910.279892:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387911.303965:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387911.534336:0:6798:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1787387912.200047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787387912.200058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787387912.200061:0:8:0:(import.c:65:import_set_state_nolock()) 0000000010937ae4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787387912.200074:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000010937ae4 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787387912.200093:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b6570c18 x1874211971796224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387912.200132:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6570c18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971796224:0@lo:38: 00000100:00100000:0.0:1787387912.200215:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387912.200561:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004cc88b95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971796096:0@lo:400: 00000100:00100000:1.0:1787387912.200600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387912.201148:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796224 00000100:00100000:3.0:1787387912.201171:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796224 00000100:00100000:3.0:1787387912.201296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387912.201303:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c570ae27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971796224:12345-0@lo:38: 00010000:00080000:3.0:1787387912.201329:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1787387912.201385:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5cb77467b181167e 00000004:00100000:3.0:1787387912.201556:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787387912.201995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796096 00000100:00100000:2.0:1787387912.202001:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796096 00000100:00100000:2.0:1787387912.202046:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387912.202053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd09da34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:3646:x1874211971796096:12345-0@lo:400: 00000100:00100000:2.0:1787387912.202192:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd09da34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:3646:x1874211971796096:12345-0@lo:400: Request processed in 139us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387912.202201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787387912.202511:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004cc88b95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971796096:0@lo:400: 00000100:00080000:3.0:1787387912.202968:0:6522:0:(import.c:65:import_set_state_nolock()) 000000007e330f49 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387912.203028:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c570ae27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874211971796224:12345-0@lo:38: Request processed in 1725us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387912.203036:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787387912.206270:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b6570c18 x1874211971796224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787387912.206296:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787387912.206307:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787387912.206315:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387912.206319:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000010937ae4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387912.206326:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6570c18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971796224:0@lo:38: 00010000:00010000:1.0:1787387912.328458:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787387912.537141:0:6850:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387912.537392:0:6850:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787387913.351918:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787387913.735881:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787387913.735891:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c9714000 from 3 10000000:01000000:2.0:1787387913.735895:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787387913.735978:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387913.735991:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387913.736001:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387913.736025:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cfc1d1b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971796352:0@lo:101: 00000100:00100000:2.0:1787387913.736109:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387913.736203:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 0000000082fbcd9a going to sleep for 11 seconds 00000100:00100000:0.0:1787387913.736415:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796352 00000100:00100000:0.0:1787387913.736424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796352 00000100:00100000:0.0:1787387913.736475:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387913.736483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000661d0cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:6517:x1874211971796352:12345-0@lo:101: 00010000:00010000:0.0:1787387913.736497:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387913.736512:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811685 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387913.736534:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811685 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387913.736545:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811685 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387913.736553:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092853db7, rc 0) 00000100:00100000:0.0:1787387913.736597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000661d0cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6517:x1874211971796352:12345-0@lo:101: Request processed in 115us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387913.736604:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387913.737447:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cfc1d1b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971796352:0@lo:101: 00010000:00010000:1.0:1787387913.737466:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387913.737477:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387913.737540:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971796480:0@lo:256: 00000100:00100000:1.0:1787387913.737591:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387913.737629:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a8735d69 going to sleep for 11 seconds 00000100:00100000:0.0:1787387913.737902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796480 00000100:00100000:0.0:1787387913.737907:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796480 00000100:00100000:0.0:1787387913.737952:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387913.737960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000648619ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6517:x1874211971796480:12345-0@lo:256: 20000000:01000000:0.0:1787387913.737973:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787387913.737989:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787387913.737992:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787387913.738079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000648619ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:6517:x1874211971796480:12345-0@lo:256: Request processed in 121us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387913.738086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787387913.738278:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971796480:0@lo:256: 10000000:01000000:2.0:1787387913.738339:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387913.738348:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387913.738357:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387914.391366:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787387915.261352:0:6951:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387915.262317:0:6951:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787387915.401828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387916.424993:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387917.321073:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ef3fdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971796736:0@lo:400: 00000100:00100000:1.0:1787387917.321148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387917.321251:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971796608:0@lo:400: 00000100:00100000:3.0:1787387917.321285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387917.321342:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796736 00000100:00100000:3.0:1787387917.321362:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796736 00000100:00100000:3.0:1787387917.321406:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387917.321414:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080721caa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971796736:12345-0@lo:400: 00000100:00100000:3.0:1787387917.321465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080721caa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971796736:12345-0@lo:400: Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387917.321473:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787387917.321516:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008ef3fdf2 x1874211971796736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387917.321530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ef3fdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971796736:0@lo:400: 00000100:00100000:1.0:1787387917.321639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796608 00000100:00100000:1.0:1787387917.321643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796608 00000100:00100000:1.0:1787387917.321704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387917.321711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006afc39ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3647:x1874211971796608:12345-0@lo:400: 00000100:00100000:1.0:1787387917.321745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006afc39ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3647:x1874211971796608:12345-0@lo:400: Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387917.321751:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387917.321914:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971796608:0@lo:400: 00010000:00010000:0.0:1787387917.448929:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387918.471801:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387919.516393:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387920.520814:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387921.544012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387922.440062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d657f40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971796992:0@lo:400: 00000100:00100000:2.0:1787387922.440153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387922.440868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e8c5bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971796864:0@lo:400: 00000100:00100000:3.0:1787387922.440910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387922.440969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796992 00000100:00100000:3.0:1787387922.440977:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796992 00000100:00100000:3.0:1787387922.441021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387922.441028:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0995984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971796992:12345-0@lo:400: 00000100:00100000:3.0:1787387922.441076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0995984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971796992:12345-0@lo:400: Request processed in 48us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.441083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787387922.441120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005d657f40 x1874211971796992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387922.441147:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d657f40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971796992:0@lo:400: 00000100:00100000:2.0:1787387922.441767:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971796864 00000100:00100000:2.0:1787387922.441774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971796864 00000100:00100000:2.0:1787387922.441817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387922.441824:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea653b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3645:x1874211971796864:12345-0@lo:400: 00000100:00100000:2.0:1787387922.441884:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea653b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3645:x1874211971796864:12345-0@lo:400: Request processed in 61us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387922.441891:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387922.442073:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e8c5bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971796864:0@lo:400: 00010000:00010000:3.0:1787387922.574534:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387923.592781:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787387924.286219:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787387924.286224:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787387924.286226:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787387924.286355:0:7449:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000ecaa1bf5 00000020:01000004:0.0:1787387924.286372:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787387924.286382:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787387924.286406:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000002566aa90) 00000020:00000080:0.0:1787387924.286428:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787387924.352559:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787387924.352641:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1787387924.387968:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787387924.389627:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787387924.389639:0:7449:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787387924.389650:0:7449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b181169a 00000020:01000004:2.0:1787387924.389657:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787387924.390002:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787387924.390007:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787387924.390013:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787387924.390041:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787387924.390045:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787387924.412593:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787387924.412642:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.152@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1787387924.412651:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787387924.412653:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787387924.412654:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387924.412654:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387924.412655:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387924.412657:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387924.412658:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387924.412660:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387924.412661:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387924.412662:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387924.412664:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387924.412670:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1787387924.412673:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387924.412674:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787387924.412675:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387924.414301:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387924.414313:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387924.414316:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387924.414317:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387924.414319:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387924.414320:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387924.414322:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387924.414323:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387924.414372:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787387924.414397:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096e0c990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971797120:0@lo:253: 00000100:00100000:2.0:1787387924.414509:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.414563:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006fef160f going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.414663:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797120 00000100:00100000:3.0:1787387924.414671:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797120 00000100:00100000:3.0:1787387924.414751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787387924.414760:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbf58bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971797120:12345-0@lo:253: 20000000:01000000:3.0:1787387924.414791:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787387924.414796:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1787387924.414801:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1787387924.414804:0:6515:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1787387924.414851:0:6515:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787387924.415105:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387924.415252:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787387924.415267:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787387924.415284:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787387924.415301:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787387924.415314:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787387924.415373:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787387924.415381:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787387924.415393:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787387924.415399:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787387924.415410:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787387924.415415:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787387924.415426:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787387924.415442:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787387924.415544:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787387924.415554:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:3.0:1787387924.415568:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787387924.415574:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787387924.415596:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787387924.415603:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:3.0:1787387924.415616:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787387924.415621:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787387924.415634:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787387924.415649:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787387924.415659:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787387924.415778:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787387924.415789:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787387924.415802:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787387924.415820:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787387924.415837:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787387924.415844:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787387924.415857:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787387924.415878:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787387924.415884:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787387924.415904:0:6515:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787387924.415911:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1787387924.416392:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787387924.416609:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787387924.416628:0:6515:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.152@tcp for mdt 20000000:01000000:1.0:1787387924.416630:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:1.0:1787387924.416647:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787387924.416653:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787387924.416666:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787387924.416673:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:1.0:1787387924.416721:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787387924.416731:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787387924.416745:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787387924.416761:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787387924.416811:0:6515:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787387924.416820:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787387924.417478:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1787387924.417657:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787387924.417707:0:6515:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.204.152@tcp for mdt 20000000:01000000:0.0:1787387924.417709:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:0.0:1787387924.417724:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787387924.417730:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787387924.417740:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787387924.417744:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:0.0:1787387924.417754:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787387924.417759:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1787387924.417771:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787387924.417785:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1787387924.417807:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787387924.417810:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787387924.417814:0:6515:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787387924.417861:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787387924.417864:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787387924.418164:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787387924.418182:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787387924.418207:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787387924.421640:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1787387924.421714:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1787387924.421736:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1787387924.421751:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787387924.421754:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387924.424759:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387924.424817:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387924.424836:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787387924.431760:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787387924.431796:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787387924.431823:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787387924.431834:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787387924.431836:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387924.434034:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387924.434080:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387924.434093:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787387924.434287:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787387924.434311:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787387924.434327:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787387924.434343:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787387924.434345:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787387924.434351:0:6515:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787387924.434358:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787387924.434826:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1787387924.434875:0:6515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787387924.459528:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787387924.460543:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460567:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18115cf expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460574:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18115eb expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460592:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181165b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460615:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460658:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b181165b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460676:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b181165b expref: 12 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.460711:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6570c18 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874211971797248:0@lo:104: 00000100:00100000:0.0:1787387924.460779:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387924.460837:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18115eb expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.460845:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18115eb expref: 12 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.460852:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c31d0ec0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874211971797376:0@lo:104: 00000100:00100000:0.0:1787387924.460871:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387924.460897:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18115cf expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.460901:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797248 00010000:00010000:0.0:1787387924.460904:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18115cf expref: 12 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.460909:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797248 00000100:00100000:0.0:1787387924.460910:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000226acd7b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874211971797504:0@lo:104: 00000100:00100000:0.0:1787387924.460945:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.460956:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000253e2d72 going to sleep for 11 seconds 00000100:00100000:1.0:1787387924.460966:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797376 00000100:00100000:1.0:1787387924.460969:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797376 00000100:00100000:1.0:1787387924.460979:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797504 00000100:00100000:1.0:1787387924.460981:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797504 00000100:00100000:1.0:1787387924.460993:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387924.461000:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eb7f229 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6515:x1874211971797248:12345-0@lo:104: 00010000:00010000:1.0:1787387924.461011:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.461075:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387924.461080:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eb7f229 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6515:x1874211971797248:12345-0@lo:104: Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.461087:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387924.461106:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387924.461111:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec92ac42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6515:x1874211971797376:12345-0@lo:104: 00010000:00010000:1.0:1787387924.461117:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.461148:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787387924.461152:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec92ac42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6515:x1874211971797376:12345-0@lo:104: Request processed in 42us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.461158:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387924.461170:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387924.461175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdff42f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6515:x1874211971797504:12345-0@lo:104: 00010000:00010000:1.0:1787387924.461180:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461369:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387924.461376:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461382:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000856154f0 already unused, calling callback (00000000695490a4) 10000000:00010000:2.0:1787387924.461385:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461393:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387924.461405:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387924.461411:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387924.461437:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461443:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787387924.461444:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6570c18 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874211971797248:0@lo:104: 00010000:00010000:2.0:1787387924.461458:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.461459:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c31d0ec0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874211971797376:0@lo:104: 00010000:00010000:2.0:1787387924.461464:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 00000000856154f0/0x5cb77467b181165b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811662 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461476:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387924.461478:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461484:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be3a5173 already unused, calling callback (00000000695490a4) 10000000:00010000:2.0:1787387924.461485:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461490:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387924.461495:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387924.461499:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387924.461517:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461523:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387924.461548:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461554:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 00000000be3a5173/0x5cb77467b18115eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18115f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.461563:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387924.461565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387924.461566:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387924.461581:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387924.461590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d4c2d6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971797632:0@lo:103: 00000100:00100000:2.0:1787387924.461621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.461652:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387924.461660:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000140bc6d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971797760:0@lo:103: 00000100:00100000:2.0:1787387924.461705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.461853:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797632 00000100:00100000:0.0:1787387924.461858:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797632 00010000:00010000:0.0:1787387924.461878:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181165b expref: 13 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.461898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797760 00000100:00100000:0.0:1787387924.461901:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797760 00010000:00010000:0.0:1787387924.461910:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18115eb expref: 14 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.461933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387924.461939:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e0aa74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:3646:x1874211971797632:12345-0@lo:103: 00010000:00010000:0.0:1787387924.461948:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387924.461952:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181165b expref: 14 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.461960:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b181165b expref: 14 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.461974:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a81b547/0x5cb77467b1811662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b181165b expref: 14 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.461986:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387924.467933:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787387924.467957:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787387924.468985:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.469089:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387924.469099:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdff42f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6515:x1874211971797504:12345-0@lo:104: Request processed in 7921us (8150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.469099:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e0aa74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:3646:x1874211971797632:12345-0@lo:103: Request processed in 7158us (7475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.469112:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387924.469112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787387924.469138:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787387924.469140:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787387924.469143:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.469150:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f71b9bde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3645:x1874211971797760:12345-0@lo:103: 00010000:00010000:1.0:1787387924.469154:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004be6cd15 already unused, calling callback (00000000695490a4) 10000000:00010000:1.0:1787387924.469157:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.469168:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387924.469173:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.469174:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:1.0:1787387924.469178:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387924.469180:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18115eb expref: 12 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.469192:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18115eb expref: 12 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.469210:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000042a545bd/0x5cb77467b18115f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18115eb expref: 12 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.469224:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387924.469263:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f71b9bde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:3645:x1874211971797760:12345-0@lo:103: Request processed in 116us (7557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.469269:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387924.469319:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000226acd7b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874211971797504:0@lo:104: 00000100:00100000:0.0:1787387924.469319:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d4c2d6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971797632:0@lo:103: 00010000:00010000:2.0:1787387924.469345:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.469349:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000140bc6d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971797760:0@lo:103: 00010000:00010000:1.0:1787387924.470426:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.470439:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787387924.470484:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787387924.471034:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.471044:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18115cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18115d6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.471061:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.471063:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.471077:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387924.475034:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005393254a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971797888:0@lo:103: 00000100:00100000:2.0:1787387924.475106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.475473:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971797888 00000100:00100000:0.0:1787387924.475481:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971797888 00010000:00010000:0.0:1787387924.475518:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18115cf expref: 11 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.475560:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387924.475568:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a6f4f22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:3644:x1874211971797888:12345-0@lo:103: 00010000:00010000:0.0:1787387924.475621:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387924.475627:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18115cf expref: 11 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475638:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18115cf expref: 11 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475661:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df317696/0x5cb77467b18115d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18115cf expref: 11 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475676:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475709:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475724:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475731:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475736:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475741:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475746:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ef9f524 already unused, calling callback (00000000b6564a3e) 00010000:00010000:0.0:1787387924.475750:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475756:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475772:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.475793:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387924.475834:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a6f4f22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:3644:x1874211971797888:12345-0@lo:103: Request processed in 267us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.475841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387924.475877:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005393254a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971797888:0@lo:103: 00010000:00010000:1.0:1787387924.476083:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.476091:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.476096:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008ef9f524/0x5cb77467b18116a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387924.476111:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787387924.479539:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbf58bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:7449:x1874211971797120:12345-0@lo:253: Request processed in 64772us (65023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387924.479553:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096e0c990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971797120:0@lo:253: 00000100:00100000:0.0:1787387924.479554:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:01000000:2.0:1787387924.479566:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787387924.479581:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387924.479583:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787387924.479585:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387924.479586:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787387924.479587:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387924.479588:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387924.479590:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387924.479592:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787387924.479593:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387924.479594:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787387924.479614:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ecaa1bf5 from lustre-MDT0001 10000000:01000000:2.0:1787387924.479647:0:7449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787387924.479650:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787387924.479657:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9273d0f44d40 local copy 10000000:01000000:2.0:1787387924.479660:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787387924.479715:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.479726:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.479735:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387924.479752:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096e0c990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798016:0@lo:101: 00000100:00100000:2.0:1787387924.479796:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.479830:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f8923ba going to sleep for 11 seconds 00000100:00100000:0.0:1787387924.479948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798016 00000100:00100000:0.0:1787387924.479955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798016 00000100:00100000:0.0:1787387924.480050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787387924.480060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaa40b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:7449:x1874211971798016:12345-0@lo:101: 00010000:00010000:0.0:1787387924.480072:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387924.480085:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c74b562d/0x5cb77467b18116af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18116a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.480106:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c74b562d/0x5cb77467b18116af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18116a8 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.480115:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c74b562d/0x5cb77467b18116af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18116a8 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.480124:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c74b562d, rc 0) 00000100:00100000:0.0:1787387924.480165:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaa40b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:7449:x1874211971798016:12345-0@lo:101: Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.480171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387924.480843:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096e0c990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798016:0@lo:101: 00010000:00010000:1.0:1787387924.480860:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.480869:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.480989:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798144:0@lo:501: 00000100:00100000:1.0:1787387924.481027:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.491025:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003120c11 going to sleep for 11 seconds 00000100:00100000:2.0:1787387924.492714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798144 00000100:00100000:2.0:1787387924.492729:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798144 00000100:00100000:2.0:1787387924.492780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387924.492788:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009291997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:7449:x1874211971798144:12345-0@lo:501: 00000100:00100000:2.0:1787387924.492951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009291997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:7449:x1874211971798144:12345-0@lo:501: Request processed in 163us (11923us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387924.492977:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387924.497983:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798144:0@lo:501: 10000000:01000000:1.0:1787387924.498016:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787387924.498061:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787387924.498070:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.498082:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.498108:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.498133:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787387924.498161:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9273eedc0000 10000000:01000000:1.0:1787387924.498166:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387924.498170:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9273d0f44d40 10000000:01000000:1.0:1787387924.498172:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787387924.498176:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9273d0f44d40 from 1 10000000:01000000:1.0:1787387924.498179:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787387924.498326:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387924.498332:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.498345:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.498348:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007fa67e96 already unused, calling callback (00000000695490a4) 10000000:00010000:3.0:1787387924.498351:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.498351:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.498359:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.498361:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387924.498365:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387924.498370:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787387924.498379:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798272:0@lo:101: 00000100:00100000:1.0:1787387924.498440:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387924.498455:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.498462:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787387924.498498:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971798400:0@lo:103: 00000100:00100000:1.0:1787387924.498519:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000163b0f62 going to sleep for 11 seconds 00000100:00100000:0.0:1787387924.498532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.498535:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798272 00000100:00100000:1.0:1787387924.498541:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798272 00010000:00010000:3.0:1787387924.498581:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.498588:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b18116a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b18116af expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.498611:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387924.498613:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387924.498614:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387924.498719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787387924.498729:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009da868e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:7449:x1874211971798272:12345-0@lo:101: 00010000:00010000:2.0:1787387924.498742:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387924.498754:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070fcc81e/0x5cb77467b18116bd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18116b6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.502569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798400 00000100:00100000:0.0:1787387924.502607:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798400 00000100:00100000:0.0:1787387924.502784:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387924.502794:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ea9f1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:3646:x1874211971798400:12345-0@lo:103: 00010000:00010000:0.0:1787387924.502812:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387924.502832:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c74b562d/0x5cb77467b18116af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b18116a8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.502852:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387924.502936:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ea9f1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:3646:x1874211971798400:12345-0@lo:103: Request processed in 144us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.502944:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787387924.503019:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070fcc81e/0x5cb77467b18116bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18116b6 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.503032:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070fcc81e/0x5cb77467b18116bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18116b6 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.503039:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070fcc81e, rc 0) 00000100:00100000:2.0:1787387924.503084:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009da868e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:7449:x1874211971798272:12345-0@lo:101: Request processed in 4357us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387924.503091:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387924.506773:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798272:0@lo:101: 00010000:00010000:1.0:1787387924.506800:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.506835:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387924.506865:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:0.0:1787387924.506880:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe509385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971798400:0@lo:103: 00010000:00010000:1.0:1787387924.506884:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.506891:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000f29fcf19/0x5cb77467b18116b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387924.506902:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9273eedc0000 10000000:01000000:1.0:1787387924.506910:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787387924.506915:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9273eedc0000 from 1 10000000:01000000:1.0:1787387924.506928:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787387924.506962:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.506969:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.506977:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.506994:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798528:0@lo:101: 00000100:00100000:1.0:1787387924.507053:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.507096:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000163b0f62 going to sleep for 11 seconds 00000100:00100000:1.0:1787387924.507113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798528 00000100:00100000:1.0:1787387924.507120:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798528 00000100:00100000:1.0:1787387924.507166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387924.507174:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb1e773a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:7449:x1874211971798528:12345-0@lo:101: 00010000:00010000:1.0:1787387924.507199:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387924.507211:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be3a5173/0x5cb77467b18116cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18116c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507231:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be3a5173/0x5cb77467b18116cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18116c4 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507239:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be3a5173/0x5cb77467b18116cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18116c4 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507250:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be3a5173, rc 0) 00000100:00100000:1.0:1787387924.507288:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb1e773a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:7449:x1874211971798528:12345-0@lo:101: Request processed in 115us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.507294:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387924.507326:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798528:0@lo:101: 00010000:00010000:1.0:1787387924.507335:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507342:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387924.507353:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787387924.507361:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507368:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000004be6cd15/0x5cb77467b18116c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387924.507384:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787387924.507397:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387924.507402:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9273eedc0000 10000000:01000000:1.0:1787387924.507404:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787387924.507407:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787387924.507408:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787387924.507423:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507429:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.507435:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.507447:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798656:0@lo:101: 00000100:00100000:1.0:1787387924.507471:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387924.507482:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798656 00000100:00100000:1.0:1787387924.507482:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000163b0f62 going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.507487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798656 00000100:00100000:3.0:1787387924.507510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787387924.507515:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009273ad0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+11:7449:x1874211971798656:12345-0@lo:101: 00010000:00010000:3.0:1787387924.507522:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387924.507535:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af9f7519/0x5cb77467b18116d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18116d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.507549:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af9f7519/0x5cb77467b18116d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.507557:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af9f7519/0x5cb77467b18116d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.507562:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af9f7519, rc 0) 00000100:00100000:3.0:1787387924.507629:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009273ad0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971798656:12345-0@lo:101: Request processed in 114us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.507635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387924.512910:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798656:0@lo:101: 00010000:00010000:1.0:1787387924.512950:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.512962:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.513092:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798784:0@lo:501: 00000100:00100000:1.0:1787387924.513157:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.513232:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000163b0f62 going to sleep for 11 seconds 00000100:00100000:0.0:1787387924.513481:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798784 00000100:00100000:0.0:1787387924.513489:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798784 00000100:00100000:0.0:1787387924.513544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787387924.513552:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f400c3e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971798784:12345-0@lo:501: 00000100:00100000:0.0:1787387924.513736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f400c3e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971798784:12345-0@lo:501: Request processed in 185us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.513745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387924.513857:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8b729b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798784:0@lo:501: 00000100:00100000:2.0:1787387924.513891:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798912:0@lo:503: 00000100:00100000:2.0:1787387924.513946:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.513973:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000713130fd going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.514035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971798912 00000100:00100000:3.0:1787387924.514041:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971798912 00000100:00100000:3.0:1787387924.514074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787387924.514081:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe256e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971798912:12345-0@lo:503: 00000100:00100000:3.0:1787387924.514164:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe256e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971798912:12345-0@lo:503: Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.514172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787387924.514318:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971798912:0@lo:503: 00000040:00080000:2.0:1787387924.514587:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387924.514665:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799040:0@lo:502: 00000100:00100000:2.0:1787387924.514736:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.514752:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000713130fd going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.514870:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799040 00000100:00100000:3.0:1787387924.514875:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799040 00000100:00100000:3.0:1787387924.514894:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787387924.514899:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086a43e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971799040:12345-0@lo:502: 00000100:00100000:3.0:1787387924.514994:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086a43e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971799040:12345-0@lo:502: Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.515011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787387924.515200:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799040:0@lo:502: 00000040:00080000:2.0:1787387924.515411:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787387924.515436:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787387924.515451:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787387924.515464:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787387924.515477:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787387924.515490:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787387924.515502:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787387924.515513:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787387924.515526:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787387924.515538:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787387924.515549:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787387924.515560:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787387924.515574:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787387924.515586:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787387924.515599:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787387924.515612:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787387924.515625:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787387924.515637:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787387924.515649:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787387924.515660:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787387924.515672:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787387924.515722:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787387924.515736:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787387924.515758:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799168:0@lo:502: 00000100:00100000:2.0:1787387924.515799:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.515826:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000713130fd going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.516031:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799168 00000100:00100000:3.0:1787387924.516037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799168 00000100:00100000:3.0:1787387924.516072:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387924.516078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d63d296 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971799168:12345-0@lo:502: 00000100:00100000:3.0:1787387924.516167:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d63d296 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971799168:12345-0@lo:502: Request processed in 90us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.516175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387924.516364:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799168:0@lo:502: 00000040:00080000:2.0:1787387924.516416:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1787387924.516423:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1787387924.517264:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387924.517275:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.517277:0:7462:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787387924.517282:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787387924.517285:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387924.517298:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002236d400) 00000020:00000080:2.0:1787387924.517317:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1787387924.517323:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787387924.517451:0:7462:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787387924.517458:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b18116e7 00000020:00000080:2.0:1787387924.517835:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787387924.517839:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387924.517843:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.517844:0:7462:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787387924.517846:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387924.517849:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.517850:0:7462:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787387924.517853:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387924.517869:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a3548bc8) 00000020:00000080:2.0:1787387924.517880:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1787387924.517884:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787387924.517886:0:7462:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787387924.517889:0:7462:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787387924.517894:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787387924.517970:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ecaa1bf5 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787387924.517981:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000c3cbf78e) 00000020:00000080:2.0:1787387924.517989:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1787387924.518143:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787387924.518148:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b18116fc 00000020:00000080:2.0:1787387924.518245:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787387924.518251:0:7462:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787387924.518255:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5cb77467b1811703 00080000:01000000:2.0:1787387924.518261:0:7462:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787387924.518270:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b181170a 00080000:10000000:2.0:1787387924.519486:0:7462:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787387924.519640:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1787387924.615851:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.637820:0:7462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1787387924.638192:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1787387924.643982:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787387924.644902:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787387924.661498:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787387924.661511:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387924.661517:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387924.661519:0:7462:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787387924.661522:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387924.661527:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387924.661528:0:7462:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787387924.661531:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787387924.661537:0:7462:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:00000080:1.0:1787387924.661562:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387924.661596:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000c04d4ec0) 00000020:00000080:1.0:1787387924.661619:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787387924.661627:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787387924.661724:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787387924.661731:0:7462:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787387924.661737:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1811718 00010000:00080000:1.0:1787387924.661769:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b856c21e@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:1.0:1787387924.667897:0:7462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787387924.670396:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787387924.670411:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787387924.670450:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787387924.670472:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b181171f 00000100:00080000:2.0:1787387924.670484:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387924.670489:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000b856c21e using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787387924.670523:0:7462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e7f5b6bd x1874211971799296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387924.670550:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787387924.670645:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387924.670649:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.670651:0:7462:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787387924.670653:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787387924.670655:0:7462:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787387924.670658:0:7462:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787387924.670659:0:7462:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787387924.670660:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787387924.670662:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.670663:0:7462:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787387924.670665:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387924.670669:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.670670:0:7462:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787387924.670673:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787387924.670726:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787387924.670739:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387924.670742:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.670743:0:7462:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787387924.670744:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387924.670763:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.670764:0:7462:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387924.670768:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387924.670769:0:7462:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787387924.670799:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387924.670802:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387924.670803:0:7462:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387924.670806:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787387924.670904:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971799424:0@lo:400: 00000100:00100000:2.0:1787387924.670984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787387924.671059:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1787387924.671095:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787387924.671106:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.671116:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000002f679a01/0x5cb77467b18116d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387924.671123:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273eedc0000 from 1 10000000:01000000:2.0:1787387924.671125:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787387924.671147:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.671154:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.671163:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387924.671175:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004d4da4c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799552:0@lo:101: 00000100:00100000:2.0:1787387924.671204:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.671230:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053372cf9 going to sleep for 11 seconds 00000100:00100000:2.0:1787387924.671259:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799424 00000100:00100000:2.0:1787387924.671267:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799424 00000100:00100000:2.0:1787387924.671307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387924.671314:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c2418a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971799424:12345-0@lo:400: 00000100:00100000:2.0:1787387924.671361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c2418a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971799424:12345-0@lo:400: Request processed in 47us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387924.671369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387924.671374:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971799296:0@lo:38: 00010000:00080000:2.0:1787387924.671403:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007b3d0bdf x1874211971799424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387924.671409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.671415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971799424:0@lo:400: 00000100:00100000:2.0:1787387924.671960:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799552 00000100:00100000:2.0:1787387924.671966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799552 00000100:00100000:2.0:1787387924.672001:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387924.672008:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b16d7d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+12:7449:x1874211971799552:12345-0@lo:101: 00010000:00010000:2.0:1787387924.672017:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387924.672029:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811726 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.672051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811726 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.672061:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811726 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.672070:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df317696, rc 0) 00000100:00100000:2.0:1787387924.672117:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b16d7d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7449:x1874211971799552:12345-0@lo:101: Request processed in 110us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.672119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799296 00000100:00100000:1.0:1787387924.672124:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799296 00000100:00100000:2.0:1787387924.672136:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387924.672146:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387924.672151:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099f931b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971799296:12345-0@lo:38: 00010000:00080000:1.0:1787387924.672171:0:6525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1787387924.672204:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1811734 00000004:00100000:1.0:1787387924.672223:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787387924.672229:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787387924.672261:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004d4da4c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799552:0@lo:101: 00010000:00010000:0.0:1787387924.672275:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.672293:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.672994:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799680:0@lo:256: 00000100:00100000:0.0:1787387924.673044:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.673079:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000253e2d72 going to sleep for 11 seconds 00000100:00100000:1.0:1787387924.673124:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799680 00000100:00100000:1.0:1787387924.673130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799680 00000100:00100000:2.0:1787387924.673236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387924.673245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039500b1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7449:x1874211971799680:12345-0@lo:256: 20000000:01000000:2.0:1787387924.673260:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787387924.673275:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787387924.673278:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787387924.673370:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039500b1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7449:x1874211971799680:12345-0@lo:256: Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.673492:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799680:0@lo:256: 00000100:00100000:2.0:1787387924.673649:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 10000000:01000000:0.0:1787387924.674315:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787387924.674332:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.674342:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387924.674349:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eedc0000 from 1 10000000:01000000:0.0:1787387924.674352:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387924.674375:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.674392:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.674400:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.674414:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799808:0@lo:101: 00000100:00100000:0.0:1787387924.674447:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.675123:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000253e2d72 going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.676130:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799808 00000100:00100000:3.0:1787387924.676141:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799808 00000100:00100000:3.0:1787387924.676191:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787387924.676199:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9f6a976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7449:x1874211971799808:12345-0@lo:101: 00010000:00010000:3.0:1787387924.676213:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387924.676229:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181173b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.676259:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181173b expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.676269:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181173b expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.676280:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000090c83b2, rc 0) 00000100:00100000:3.0:1787387924.676346:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9f6a976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:7449:x1874211971799808:12345-0@lo:101: Request processed in 148us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.676353:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787387924.676482:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799808:0@lo:101: 00010000:00010000:0.0:1787387924.676497:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.676505:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387924.676973:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799936:0@lo:501: 00000100:00100000:0.0:1787387924.677089:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.677123:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000253e2d72 going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.677189:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971799936 00000100:00100000:3.0:1787387924.677194:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971799936 00000100:00100000:3.0:1787387924.677264:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387924.677272:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052ad321b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:7449:x1874211971799936:12345-0@lo:501: 00000100:00100000:3.0:1787387924.677367:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052ad321b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:7449:x1874211971799936:12345-0@lo:501: Request processed in 96us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.677464:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971799936:0@lo:501: 00000100:00100000:0.0:1787387924.677491:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800064:0@lo:503: 00000100:00100000:0.0:1787387924.677527:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.677546:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000253e2d72 going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.677653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387924.677674:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800064 00000100:00100000:3.0:1787387924.677738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800064 00000100:00100000:3.0:1787387924.677800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387924.677807:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000824c815e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:7449:x1874211971800064:12345-0@lo:503: 00000040:00080000:3.0:1787387924.677837:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387924.677876:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000824c815e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:7449:x1874211971800064:12345-0@lo:503: Request processed in 69us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.677883:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387924.677990:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056ddbdb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800064:0@lo:503: 00000040:00080000:3.0:1787387924.678307:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387924.678355:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787387924.678495:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387924.679299:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787387924.680929:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787387924.680975:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387924.680997:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.681010:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387924.681068:0:7449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787387924.681072:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9273eedc0000 10000000:01000000:3.0:1787387924.681075:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9273eedc0000 10000000:01000000:3.0:1787387924.681079:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787387924.681085:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eedc0000 from 1 10000000:01000000:3.0:1787387924.681088:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787387924.681121:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.681138:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.681148:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387924.681169:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002d81b00a pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800192:0@lo:101: 00000100:00100000:3.0:1787387924.681230:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.681272:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800192 00000100:00100000:3.0:1787387924.681275:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030659097 going to sleep for 11 seconds 00000100:00100000:0.0:1787387924.681280:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800192 00000100:00100000:0.0:1787387924.681317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387924.681324:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044e51b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:7449:x1874211971800192:12345-0@lo:101: 00010000:00010000:0.0:1787387924.681336:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387924.681348:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc08d1a4/0x5cb77467b1811750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811749 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.681376:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc08d1a4/0x5cb77467b1811750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811749 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.681386:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc08d1a4/0x5cb77467b1811750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811749 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387924.681403:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc08d1a4, rc 0) 00000100:00100000:0.0:1787387924.681452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044e51b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800192:12345-0@lo:101: Request processed in 128us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.681460:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787387924.681541:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002d81b00a pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800192:0@lo:101: 00010000:00010000:2.0:1787387924.681554:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387924.681562:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387924.681883:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800320:0@lo:501: 00000100:00100000:2.0:1787387924.681926:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.681954:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000713130fd going to sleep for 11 seconds 00000100:00100000:0.0:1787387924.681960:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800320 00000100:00100000:0.0:1787387924.681964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800320 00000100:00100000:0.0:1787387924.682113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387924.682123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071c610f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800320:12345-0@lo:501: 00000100:00100000:0.0:1787387924.682227:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071c610f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800320:12345-0@lo:501: Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.682235:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787387924.682302:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800320:0@lo:501: 00000100:00100000:2.0:1787387924.682333:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800448:0@lo:503: 00000100:00100000:2.0:1787387924.682374:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.682446:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000713130fd going to sleep for 11 seconds 00000100:00100000:0.0:1787387924.682460:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800448 00000100:00100000:0.0:1787387924.682464:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800448 00000100:00100000:0.0:1787387924.682491:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787387924.682497:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5a13ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800448:12345-0@lo:503: 00000100:00100000:0.0:1787387924.682732:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5a13ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800448:12345-0@lo:503: Request processed in 235us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.682740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787387924.683036:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800448:0@lo:503: 00000100:00080000:1.0:1787387924.683088:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000bf7bf104 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387924.683146:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099f931b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874211971799296:12345-0@lo:38: Request processed in 10993us (11736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.683155:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1787387924.683266:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387924.683338:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800576:0@lo:502: 00000100:00100000:2.0:1787387924.683375:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.683407:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000713130fd going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.683457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800576 00000100:00100000:3.0:1787387924.683462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800576 00000100:00100000:3.0:1787387924.683492:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787387924.683498:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000174c7dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800576:12345-0@lo:502: 00000100:00100000:3.0:1787387924.683584:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000174c7dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800576:12345-0@lo:502: Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.683594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387924.683815:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387924.683823:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787387924.683832:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787387924.683838:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387924.683841:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000b856c21e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387924.683854:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7f5b6bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971799296:0@lo:38: 00000100:00100000:0.0:1787387924.683894:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a774fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971800704:0@lo:41: 00000100:00100000:0.0:1787387924.683940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.684300:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800576:0@lo:502: 00000040:00080000:2.0:1787387924.684483:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787387924.684512:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787387924.684528:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787387924.684543:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787387924.684556:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787387924.684569:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787387924.684583:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787387924.684597:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787387924.684610:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787387924.684620:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787387924.684634:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787387924.684660:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787387924.684674:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787387924.684707:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787387924.684722:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787387924.684735:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000100:00100000:3.0:1787387924.685182:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800704 00000100:00100000:3.0:1787387924.685189:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800704 00000100:00100000:3.0:1787387924.685261:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387924.685268:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a4d9f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971800704:12345-0@lo:41: 00000004:00000024:3.0:1787387924.685305:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787387924.685364:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a4d9f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971800704:12345-0@lo:41: Request processed in 96us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.685370:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1787387924.685444:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787387924.685467:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787387924.685479:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787387924.685492:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787387924.685504:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787387924.685528:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787387924.685545:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000100:00100000:2.0:1787387924.685562:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a774fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971800704:0@lo:41: 00000040:00080000:0.0:1787387924.685565:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787387924.685886:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787387924.685901:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787387924.685924:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787387924.685940:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787387924.685970:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ead59354 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800832:0@lo:502: 00000100:00100000:0.0:1787387924.686129:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.686212:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a87ab0d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787387924.686981:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800832 00000100:00100000:2.0:1787387924.687158:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800832 00000100:00100000:3.0:1787387924.687315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787387924.687325:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb1bf69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800832:12345-0@lo:502: 00000100:00100000:3.0:1787387924.687505:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb1bf69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971800832:12345-0@lo:502: Request processed in 181us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.687519:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787387924.688148:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ead59354 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971800832:0@lo:502: 00000040:00080000:0.0:1787387924.688221:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787387924.688239:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787387924.689323:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787387924.689340:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000045c6719c) 00000020:00000080:3.0:1787387924.689363:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787387924.689543:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ecaa1bf5 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787387924.689548:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ecaa1bf5 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787387924.689550:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ecaa1bf5 3 00010000:00080000:3.0:1787387924.689581:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aee44401@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787387924.692872:0:7468:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787387924.692990:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787387924.693033:0:7468:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787387924.693046:0:7468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5cb77467b181175e 00000100:00080000:3.0:1787387924.693056:0:7468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387924.693061:0:7468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000aee44401 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787387924.693096:0:7468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d3ae3285 x1874211971800960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387924.693178:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d3ae3285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874211971800960:0@lo:38: 00000100:00100000:0.0:1787387924.693248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787387924.693316:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787387924.693342:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971800960 00000100:00100000:1.0:1787387924.693351:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971800960 00000100:00100000:1.0:1787387924.693512:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387924.693519:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ead59354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874211971800960:12345-0@lo:38: 00010000:00080000:1.0:1787387924.693545:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1787387924.693597:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5cb77467b1811765 00000004:00100000:1.0:1787387924.693612:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787387924.693645:0:6521:0:(import.c:65:import_set_state_nolock()) 00000000d5c3f788 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387924.693731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ead59354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874211971800960:12345-0@lo:38: Request processed in 210us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.693740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787387924.693756:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d3ae3285 x1874211971800960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387924.693779:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387924.693787:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787387924.693795:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787387924.693799:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787387924.693808:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000aee44401 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787387924.693814:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d3ae3285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874211971800960:0@lo:38: 00000040:00080000:3.0:1787387924.698565:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1787387924.698596:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1787387924.698792:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787387924.698820:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387924.698842:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.698855:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 00000000b94b9764/0x5cb77467b1811749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787387924.698904:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787387924.698910:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787387924.698922:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387924.698923:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387924.698924:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387924.698926:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387924.698927:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387924.698928:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387924.698930:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387924.698931:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387924.698932:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387924.698936:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787387924.698938:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387924.698939:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787387924.698940:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387924.698941:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387924.698942:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387924.698943:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387924.698943:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387924.698944:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387924.698945:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387924.698946:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387924.698947:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387924.698973:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787387924.698990:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007ed07d8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971801088:0@lo:253: 00000100:00100000:1.0:1787387924.699058:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.699102:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d4ff628a going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.699128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801088 00000100:00100000:3.0:1787387924.699136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801088 00000100:00100000:3.0:1787387924.699186:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787387924.699194:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c578851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971801088:12345-0@lo:253: 20000000:01000000:3.0:1787387924.699225:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787387924.699240:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787387924.704114:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787387924.706207:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787387924.706234:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787387924.706403:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787387924.706409:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787387924.706431:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706451:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811685 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706459:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706478:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706519:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706533:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.706549:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089831699 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971801216:0@lo:104: 00000100:00100000:1.0:1787387924.706621:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387924.706659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c578851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7449:x1874211971801088:12345-0@lo:253: Request processed in 7462us (7598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.706671:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1787387924.706709:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811685 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706719:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811685 expref: 14 pid: 6513 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.706728:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971801344:0@lo:104: 00000100:00100000:1.0:1787387924.706753:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.706778:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b328093f going to sleep for 11 seconds 00000100:00100000:1.0:1787387924.706801:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801216 00000100:00100000:1.0:1787387924.706809:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801216 00000100:00100000:1.0:1787387924.706837:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801344 00000100:00100000:1.0:1787387924.706840:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801344 00000100:00100000:1.0:1787387924.706854:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387924.706861:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3701592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6536:x1874211971801216:12345-0@lo:104: 00010000:00010000:1.0:1787387924.706873:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.706952:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387924.706958:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3701592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6536:x1874211971801216:12345-0@lo:104: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.706965:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387924.706977:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089831699 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971801216:0@lo:104: 00000100:00100000:1.0:1787387924.706983:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387924.706991:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f293931 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971801344:12345-0@lo:104: 00010000:00010000:3.0:1787387924.706993:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387924.706998:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707009:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707019:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007fa67e96 already unused, calling callback (00000000695490a4) 10000000:00010000:3.0:1787387924.707023:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707032:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.707037:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1787387924.707039:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.707045:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f293931 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971801344:12345-0@lo:104: Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.707053:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 10000000:01000000:3.0:1787387924.707062:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387924.707067:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387924.707094:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707102:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387924.707121:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707127:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 000000007fa67e96/0x5cb77467b1811726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181172d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707139:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387924.707147:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387924.707149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387924.707162:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045bbd970 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971801472:0@lo:103: 00000100:00100000:3.0:1787387924.707195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387924.707239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801472 00000100:00100000:3.0:1787387924.707243:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801472 00010000:00010000:1.0:1787387924.707250:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.707257:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707261:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387924.707284:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387924.707289:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4effb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3645:x1874211971801472:12345-0@lo:103: 00010000:00010000:3.0:1787387924.707297:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387924.707301:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707309:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707320:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df317696/0x5cb77467b181172d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811726 expref: 15 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.707330:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387924.707354:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4effb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:3645:x1874211971801472:12345-0@lo:103: Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.707360:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387924.707384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045bbd970 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971801472:0@lo:103: 00000100:00100000:3.0:1787387924.707415:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971801344:0@lo:104: 00010000:00010000:3.0:1787387924.707433:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387924.707440:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007ed07d8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7449:1874211971801088:0@lo:253: 10000000:01000000:2.0:1787387924.707452:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787387924.707456:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387924.707458:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787387924.707460:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387924.707461:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387924.707463:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387924.707464:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387924.707466:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387924.707467:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387924.707469:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387924.707470:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387924.707471:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787387924.707483:0:7449:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787387924.708439:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000082214336 already unused, calling callback (00000000695490a4) 10000000:00010000:1.0:1787387924.708443:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.708452:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387924.708458:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387924.708476:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387924.708513:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.708519:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387924.711440:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387924.711449:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387924.712539:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1787387924.712566:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.712579:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 0000000082214336/0x5cb77467b1811685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181168c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.712601:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.712603:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387924.712605:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787387924.714233:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1787387924.715224:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787387924.715627:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00000100:00100000:3.0:1787387924.715881:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f49c40d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971801600:0@lo:103: 00000100:00100000:3.0:1787387924.715968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1787387924.716177:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787387924.716394:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787387924.716547:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787387924.717674:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787387924.717955:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787387924.718123:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787387924.719117:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787387924.719493:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787387924.719886:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:1.0:1787387924.720255:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801600 00000100:00100000:1.0:1787387924.720484:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801600 00010000:00010000:1.0:1787387924.720522:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811685 expref: 14 pid: 6513 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.720597:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387924.720606:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095a2ddc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:3647:x1874211971801600:12345-0@lo:103: 00010000:00010000:1.0:1787387924.720620:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387924.720625:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811685 expref: 14 pid: 6513 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720637:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811685 expref: 14 pid: 6513 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720654:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000092853db7/0x5cb77467b181168c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811685 expref: 14 pid: 6513 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720702:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720710:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387924.720727:0:7461:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014318645s 00010000:00010000:1.0:1787387924.720731:0:7461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720737:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720742:0:7461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720748:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720754:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013b3c3ae already unused, calling callback (00000000b6564a3e) 00010000:00010000:1.0:1787387924.720758:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720766:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720781:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387924.720792:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387924.720875:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095a2ddc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:3647:x1874211971801600:12345-0@lo:103: Request processed in 270us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.720883:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787387924.720992:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.721000:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387924.721005:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013b3c3ae/0x5cb77467b181176c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387924.722665:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f49c40d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971801600:0@lo:103: 00000040:01000000:3.0:1787387924.722896:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787387924.723135:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1787387924.723177:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f49c40d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874211971801728:0@lo:700: 00000100:00100000:1.0:1787387924.723245:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1787387924.723314:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787387924.723527:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af341e55 going to sleep for 11 seconds 00000020:00080000:2.0:1787387924.723557:0:7474:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787387924.723570:0:7474:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787387924.723607:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801728 00000100:00100000:0.0:1787387924.723614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801728 00000100:00100000:0.0:1787387924.723710:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387924.723718:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008db4a8c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874211971801728:12345-0@lo:700: 00000100:00100000:1.0:1787387924.724134:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd6d012c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971801856:0@lo:1000: 00000100:00100000:1.0:1787387924.724181:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.724217:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040e0d911 going to sleep for 11 seconds 00000040:01000000:3.0:1787387924.724861:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787387924.725021:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787387924.725671:0:7449:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787387924.725703:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787387924.725879:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387924.726595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801856 00000100:00100000:0.0:1787387924.726617:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801856 00000100:00100000:0.0:1787387924.726711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387924.726722:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ed07d8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971801856:12345-0@lo:1000: 00000100:00100000:0.0:1787387924.726859:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ed07d8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971801856:12345-0@lo:1000: Request processed in 139us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387924.726867:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387924.726937:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd6d012c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971801856:0@lo:1000: 00000040:01000000:0.0:1787387924.726978:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787387924.727020:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e3a9722e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971801984:0@lo:700: 00000100:00100000:0.0:1787387924.727062:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387924.727094:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a87ab0d2 going to sleep for 11 seconds 00000100:00100000:3.0:1787387924.727254:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971801984 00000100:00100000:3.0:1787387924.727259:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971801984 00000100:00100000:3.0:1787387924.727537:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387924.727544:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9c000b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971801984:12345-0@lo:700: 00000100:00100000:3.0:1787387924.727604:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9c000b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971801984:12345-0@lo:700: Request processed in 62us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387924.727611:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387924.727665:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e3a9722e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971801984:0@lo:700: 00000100:00100000:1.0:1787387924.727729:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874211971802112:0@lo:900: 00000100:00100000:1.0:1787387924.727756:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.727782:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c850f138 going to sleep for 11 seconds 00000100:00100000:2.0:1787387924.727879:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971802112 00000100:00100000:2.0:1787387924.727885:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971802112 00000100:00100000:2.0:1787387924.727927:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387924.727933:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089831699 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874211971802112:12345-0@lo:900: 00000100:00100000:2.0:1787387924.727981:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089831699 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874211971802112:12345-0@lo:900: Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387924.727989:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787387924.728059:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000f9e9cc7 x1874211971802112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787387940 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387924.728071:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874211971802112:0@lo:900: 00000100:00100000:1.0:1787387924.728130:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971802240:0@lo:1000: 00000100:00100000:1.0:1787387924.728158:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.728179:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032377341 going to sleep for 11 seconds 00000100:00100000:2.0:1787387924.728241:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971802240 00000100:00100000:2.0:1787387924.728245:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971802240 00000100:00100000:2.0:1787387924.728289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387924.728294:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a774fba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971802240:12345-0@lo:1000: 00000100:00100000:2.0:1787387924.728350:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a774fba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971802240:12345-0@lo:1000: Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387924.728357:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387924.728518:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971802240:0@lo:1000: 00000004:00080000:1.0:1787387924.728560:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c850f138 with version 0 00000020:00100000:1.0:1787387924.728575:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787387924.728580:0:7476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000f9e9cc7 x1874211971802496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787387924.728601:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971802496:0@lo:1000: 00000100:00100000:1.0:1787387924.728625:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.728646:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000214d2c6d going to sleep for 11 seconds 00000100:00100000:2.0:1787387924.728851:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971802496 00000100:00100000:2.0:1787387924.728856:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971802496 00000100:00100000:2.0:1787387924.728877:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387924.728881:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b729b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971802496:12345-0@lo:1000: 00000040:00080000:2.0:1787387924.730638:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787387924.731146:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787387924.731181:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787387924.731448:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787387924.731714:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787387924.732394:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787387924.732535:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787387924.732665:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787387924.732822:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000001:00080000:0.0:1787387924.734465:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1787387924.734597:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b729b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971802496:12345-0@lo:1000: Request processed in 5711us (5968us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787387924.734611:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:1.0:1787387924.734720:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1787387924.737094:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787387924.737465:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787387924.737608:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787387924.737788:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787387924.738003:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787387924.738136:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787387924.738269:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787387924.738416:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787387924.738590:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787387924.738758:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787387924.738895:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787387924.739046:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787387924.739350:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787387924.739485:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787387924.739621:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:1.0:1787387924.743195:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008db4a8c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874211971801728:12345-0@lo:700: Request processed in 19470us (19942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.743215:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787387924.743783:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006f49c40d x1874211971801728/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387940 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387924.743799:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f49c40d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874211971801728:0@lo:700: 40000000:02000000:0.0:1787387924.743813:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:1.0:1787387924.744470:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787387924.744476:0:7476:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787387924.744492:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971802496:0@lo:1000: 00100000:10000000:2.0:1787387924.745016:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787387924.745197:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787387924.745341:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787387924.745480:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787387924.745673:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000100:00100000:1.0:1787387924.745927:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971802624:0@lo:1000: 00000100:00100000:1.0:1787387924.745992:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387924.746436:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040e0d911 going to sleep for 11 seconds 00100000:10000000:2.0:1787387924.747789:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787387924.747944:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787387924.748085:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787387924.748227:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000100:00100000:3.0:1787387924.749474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971802624 00000100:00100000:3.0:1787387924.749485:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971802624 00000100:00100000:3.0:1787387924.749539:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387924.749558:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005393254a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971802624:12345-0@lo:1000: 00000100:00100000:3.0:1787387924.749698:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005393254a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211971802624:12345-0@lo:1000: Request processed in 141us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387924.750047:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211971802624:0@lo:1000: 00000040:00080000:1.0:1787387924.750083:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787387924.750127:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c850f138 with version 1 00000004:00080000:2.0:1787387924.751456:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000163b0f62 version 1 rpc_version 1 00000020:00100000:2.0:1787387924.751504:0:7465:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787387924.751514:0:7465:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007b3d0bdf x1874211971802880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387924.751534:0:7465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1874211971802880:0@lo:1000: 00000100:00100000:2.0:1787387924.751605:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387924.751657:0:7465:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf48d49a going to sleep for 11 seconds 00100000:10000000:2.0:1787387924.752000:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787387924.752188:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000100:00100000:3.0:1787387924.753263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387924.753306:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971802880 00000100:00100000:3.0:1787387924.753314:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971802880 00000100:00100000:3.0:1787387924.753344:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387924.753350:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c6687cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874211971802880:12345-0@lo:1000: 00100000:10000000:2.0:1787387924.754932:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787387924.755131:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000040:00080000:1.0:1787387924.756627:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787387924.756844:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1787387924.757082:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787387924.762652:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787387924.762718:0:7449:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae0cc18ab988 00100000:10000000:3.0:1787387924.762725:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787387924.763176:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787387924.763207:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787387924.763224:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787387924.763239:0:7449:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787387924.783059:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387924.783268:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1787387924.787925:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387924.796160:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787387924.796244:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787387924.796250:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1787387924.806561:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787387924.818621:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c6687cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874211971802880:12345-0@lo:1000: Request processed in 65263us (67010us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787387924.818638:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787387924.818737:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787387924.818742:0:7465:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787387924.818758:0:7465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b3d0bdf pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1874211971802880:0@lo:1000: 00010000:00010000:3.0:1787387925.640810:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387926.667199:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387927.698142:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387928.711801:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387929.025985:0:7721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787387929.736092:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787387930.017647:0:7773:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387930.018199:0:7773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787387930.120466:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971803008:0@lo:400: 00000100:00100000:1.0:1787387930.120562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387930.120614:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387930.120620:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971803392:0@lo:400: 00000100:00100000:1.0:1787387930.120645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387930.120675:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971803136:0@lo:400: 00000100:00100000:1.0:1787387930.120726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387930.120745:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387930.120750:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ef3fdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971803264:0@lo:400: 00000100:00100000:1.0:1787387930.120777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387930.120827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803392 00000100:00100000:1.0:1787387930.120836:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803392 00000100:00100000:1.0:1787387930.120879:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803136 00000100:00100000:1.0:1787387930.120882:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803136 00000100:00100000:1.0:1787387930.120895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387930.120901:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c73472b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971803392:12345-0@lo:400: 00000100:00100000:1.0:1787387930.120946:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c73472b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971803392:12345-0@lo:400: Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387930.120953:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387930.120968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387930.120973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091da2d90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971803136:12345-0@lo:400: 00000100:00100000:1.0:1787387930.120997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091da2d90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971803136:12345-0@lo:400: Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387930.121016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387930.121036:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803264 00000100:00100000:1.0:1787387930.121039:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803264 00000100:00100000:1.0:1787387930.121061:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387930.121066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f49c40d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971803264:12345-0@lo:400: 00000100:00100000:1.0:1787387930.121099:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f49c40d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971803264:12345-0@lo:400: Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387930.121106:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387930.121149:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ef3fdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971803264:0@lo:400: 00010000:00080000:1.0:1787387930.121161:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003fb3a2cf x1874211971803136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387930.121171:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971803136:0@lo:400: 00010000:00080000:1.0:1787387930.121205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000089be50bf x1874211971803392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387930.121213:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089be50bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971803392:0@lo:400: 00000100:00100000:3.0:1787387930.121366:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803008 00000100:00100000:3.0:1787387930.121372:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803008 00000100:00100000:3.0:1787387930.121408:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787387930.121414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b77acdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:3647:x1874211971803008:12345-0@lo:400: 00000100:00100000:3.0:1787387930.121451:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b77acdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:3647:x1874211971803008:12345-0@lo:400: Request processed in 38us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387930.121457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787387930.122249:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387930.122263:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971803520:0@lo:41: 00000100:00100000:1.0:1787387930.122303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387930.122350:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971803008:0@lo:400: 00000100:00100000:0.0:1787387930.122972:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803520 00000100:00100000:0.0:1787387930.122981:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803520 00000100:00100000:0.0:1787387930.123030:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387930.123036:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089be50bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971803520:12345-0@lo:41: 00000004:00000024:0.0:1787387930.123081:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787387930.123137:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089be50bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971803520:12345-0@lo:41: Request processed in 100us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387930.123144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387930.123180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971803520:0@lo:41: 00010000:00010000:2.0:1787387930.766502:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387931.786000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787387932.609231:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387932.609441:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787387932.807981:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387933.698250:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdeb065710 00000020:00000080:1.0:1787387933.698269:0:7923:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787387933.698274:0:7923:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787387933.698282:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb0679a0 20000000:00000080:1.0:1787387933.698290:0:7923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9273efbaec00 uarg=0000000000000000 20000000:01000000:1.0:1787387933.698339:0:7923:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787387933.698354:0:7923:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787387933.698360:0:7923:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787387933.698449:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787387933.699122:0:7923:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 10000000:01000000:3.0:1787387933.703797:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387933.703808:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273eedc0000 from 4 10000000:01000000:3.0:1787387933.703814:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387933.703864:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387933.703877:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387933.703890:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387933.703916:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045bbd970 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971803648:0@lo:101: 00000100:00100000:3.0:1787387933.703997:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387933.704056:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dabba375 going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.704117:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803648 00000100:00100000:0.0:1787387933.704126:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803648 00000100:00100000:0.0:1787387933.704182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387933.704191:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cf8fa92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:6517:x1874211971803648:12345-0@lo:101: 00010000:00010000:0.0:1787387933.704216:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387933.704229:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e16549ec/0x5cb77467b181177a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.704260:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e16549ec/0x5cb77467b181177a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811773 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.704270:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e16549ec/0x5cb77467b181177a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811773 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.704279:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e16549ec, rc 0) 00000100:00100000:0.0:1787387933.704329:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cf8fa92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971803648:12345-0@lo:101: Request processed in 140us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.704337:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387933.704363:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045bbd970 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971803648:0@lo:101: 00010000:00010000:2.0:1787387933.704378:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.704386:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387933.704441:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094af3657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971803776:0@lo:256: 00000100:00100000:2.0:1787387933.704486:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.704510:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000933e1fe1 going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.704521:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803776 00000100:00100000:3.0:1787387933.704526:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803776 00000100:00100000:3.0:1787387933.704560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787387933.704566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092e53163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971803776:12345-0@lo:256: 20000000:01000000:3.0:1787387933.704580:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387933.704606:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387933.704610:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787387933.704709:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092e53163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971803776:12345-0@lo:256: Request processed in 143us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387933.704717:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387933.704724:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094af3657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971803776:0@lo:256: 10000000:01000000:2.0:1787387933.704778:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387933.704784:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.704801:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000003df72be7/0x5cb77467b1811773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387933.704810:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387933.704812:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273c9714000 from 21 10000000:01000000:2.0:1787387933.704814:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387933.704829:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.704836:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.704842:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387933.704853:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094af3657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971803904:0@lo:101: 00000100:00100000:2.0:1787387933.704877:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.704902:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000933e1fe1 going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.704907:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971803904 00000100:00100000:0.0:1787387933.704911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971803904 00000100:00100000:0.0:1787387933.704939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787387933.704945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053f49739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971803904:12345-0@lo:101: 00010000:00010000:0.0:1787387933.704958:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387933.704965:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fabe8f61/0x5cb77467b1811788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.704978:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fabe8f61/0x5cb77467b1811788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811781 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.704986:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fabe8f61/0x5cb77467b1811788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811781 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.704992:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fabe8f61, rc 0) 00000100:00100000:0.0:1787387933.705027:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053f49739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971803904:12345-0@lo:101: Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.705034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787387933.705051:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094af3657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971803904:0@lo:101: 00010000:00010000:2.0:1787387933.705060:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.705067:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387933.705118:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094af3657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971804032:0@lo:501: 00000100:00100000:2.0:1787387933.705142:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.705169:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000933e1fe1 going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.705219:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804032 00000100:00100000:0.0:1787387933.705223:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804032 00000100:00100000:0.0:1787387933.705314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787387933.705321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001470ebd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971804032:12345-0@lo:501: 00000100:00100000:0.0:1787387933.705579:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001470ebd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971804032:12345-0@lo:501: Request processed in 258us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.705587:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787387933.706098:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094af3657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971804032:0@lo:501: 00000100:00100000:3.0:1787387933.706132:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f3df87d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971804160:0@lo:503: 00000100:00100000:3.0:1787387933.706177:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387933.706314:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000000291f18f going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.709450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804160 00000100:00100000:0.0:1787387933.709465:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804160 00000100:00100000:0.0:1787387933.709532:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787387933.709540:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2917df6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971804160:12345-0@lo:503: 00000040:00080000:1.0:1787387933.709661:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387933.709934:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787387933.710058:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787387933.710078:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787387933.710096:0:7923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787387933.710115:0:7923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710132:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181164d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710140:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181173b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710148:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710184:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b181173b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710198:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b181173b expref: 15 pid: 6513 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.710212:0:7923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874211971804288:0@lo:104: 00000100:00100000:1.0:1787387933.710290:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.710564:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787387933.710575:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804288 00000100:00100000:1.0:1787387933.710580:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804288 00000100:00100000:1.0:1787387933.710635:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387933.710641:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e69c9151 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:7923:x1874211971804288:12345-0@lo:104: 00010000:00010000:1.0:1787387933.710653:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710724:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387933.710729:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e69c9151 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:7923:x1874211971804288:12345-0@lo:104: Request processed in 89us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387933.710747:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787387933.710810:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b181164d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710819:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b181164d expref: 15 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.710828:0:7923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000828471fb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874211971804416:0@lo:104: 00000100:00100000:1.0:1787387933.710850:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.710869:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804416 00000100:00100000:1.0:1787387933.710873:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804416 00000100:00100000:1.0:1787387933.710890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387933.710895:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3701592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:7923:x1874211971804416:12345-0@lo:104: 00010000:00010000:1.0:1787387933.710902:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.710983:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787387933.710988:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3701592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:7923:x1874211971804416:12345-0@lo:104: Request processed in 94us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387933.710995:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387933.711024:0:7923:0:(client.c:2702:ptlrpc_set_wait()) set 000000008571c052 going to sleep for 11 seconds 00000100:00100000:1.0:1787387933.711055:0:7923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874211971804288:0@lo:104: 00000100:00100000:1.0:1787387933.711065:0:7923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000828471fb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874211971804416:0@lo:104: 00010000:00010000:1.0:1787387933.711083:0:7923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711303:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387933.711309:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711317:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c74b562d already unused, calling callback (00000000695490a4) 10000000:00010000:2.0:1787387933.711320:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711327:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387933.711335:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387933.711340:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387933.711363:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711370:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387933.711396:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711402:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 00000000c74b562d/0x5cb77467b181173b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811742 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711413:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387933.711415:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711421:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000018e0bbc already unused, calling callback (00000000695490a4) 10000000:00010000:2.0:1787387933.711430:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711436:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387933.711441:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387933.711446:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387933.711471:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711477:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387933.711483:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711488:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: 00000000018e0bbc/0x5cb77467b181164d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811654 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.711506:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387933.711508:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387933.711509:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387933.711522:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5cc5065 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971804672:0@lo:103: 00000100:00100000:2.0:1787387933.711557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.711580:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387933.711586:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eab8c22e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971804544:0@lo:103: 00000100:00100000:2.0:1787387933.711610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.712027:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2917df6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971804160:12345-0@lo:503: Request processed in 2487us (5849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.712038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787387933.712096:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804672 00000100:00100000:0.0:1787387933.712106:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804672 00010000:00010000:0.0:1787387933.712129:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181164d expref: 15 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387933.712152:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804544 00000100:00100000:0.0:1787387933.712155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804544 00010000:00010000:0.0:1787387933.712163:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181173b expref: 16 pid: 6513 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387933.712180:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387933.712187:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094af3657 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:3645:x1874211971804672:12345-0@lo:103: 00010000:00010000:0.0:1787387933.712197:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387933.712201:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181164d expref: 16 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712340:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b181164d expref: 16 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712354:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009308a831/0x5cb77467b1811654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b181164d expref: 16 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712367:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387933.712402:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094af3657 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3645:x1874211971804672:12345-0@lo:103: Request processed in 215us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.712409:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387933.712424:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387933.712432:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b3d0bdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:3645:x1874211971804544:12345-0@lo:103: 00010000:00010000:0.0:1787387933.712440:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387933.712443:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181173b expref: 14 pid: 6513 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712891:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b181173b expref: 14 pid: 6513 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712903:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000090c83b2/0x5cb77467b1811742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b181173b expref: 14 pid: 6513 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712918:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712926:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712941:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.712948:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387933.713106:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f3df87d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971804160:0@lo:503: 00010000:00010000:0.0:1787387933.716313:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.716322:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.716328:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074f149e5 already unused, calling callback (00000000b6564a3e) 00010000:00010000:0.0:1787387933.716332:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.716341:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.716392:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.716408:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387933.717491:0:7923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.717507:0:7923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.717514:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074f149e5/0x5cb77467b181178f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387933.718412:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b3d0bdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:3645:x1874211971804544:12345-0@lo:103: Request processed in 5976us (6794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.718425:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387933.719042:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eab8c22e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971804544:0@lo:103: 00000100:00100000:0.0:1787387933.719057:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5cc5065 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971804672:0@lo:103: 00010000:00010000:3.0:1787387933.722493:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387933.724842:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000828471fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7924:1874211971804800:0@lo:502: 00000100:00100000:1.0:1787387933.724931:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.724973:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set 000000008571c052 going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.725187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804800 00000100:00100000:3.0:1787387933.725195:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804800 00000100:00100000:3.0:1787387933.725259:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387933.725268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000307b2455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7924:x1874211971804800:12345-0@lo:502: 00000100:00100000:3.0:1787387933.725397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000307b2455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7924:x1874211971804800:12345-0@lo:502: Request processed in 129us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387933.725406:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787387933.725650:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000828471fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7924:1874211971804800:0@lo:502: 00000100:00100000:1.0:1787387933.725761:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000828471fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7924:1874211971804928:0@lo:502: 00000100:00100000:1.0:1787387933.725797:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.725827:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set 000000008571c052 going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.725988:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971804928 00000100:00100000:0.0:1787387933.725994:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971804928 00000100:00100000:0.0:1787387933.726032:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787387933.726039:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca33297f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7924:x1874211971804928:12345-0@lo:502: 00000100:00100000:0.0:1787387933.726301:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca33297f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:7924:x1874211971804928:12345-0@lo:502: Request processed in 261us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.726309:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787387933.727125:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000828471fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7924:1874211971804928:0@lo:502: 00000040:00080000:2.0:1787387933.727163:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787387933.727480:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787387933.727504:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387933.727513:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.727523:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 000000006a81b547/0x5cb77467b1811781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387933.727543:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787387933.727545:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c9714000 from 4 10000000:01000000:1.0:1787387933.727548:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787387933.727587:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.727594:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.727602:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.727617:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805056:0@lo:101: 00000100:00100000:1.0:1787387933.727660:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.727728:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000705d770a going to sleep for 11 seconds 00000100:00100000:2.0:1787387933.728765:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805056 00000100:00100000:2.0:1787387933.728777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805056 00000100:00100000:2.0:1787387933.728824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387933.728831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8cf376d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:6517:x1874211971805056:12345-0@lo:101: 00010000:00010000:2.0:1787387933.728845:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387933.728860:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082214336/0x5cb77467b181179d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811796 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.728895:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082214336/0x5cb77467b181179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811796 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.728905:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082214336/0x5cb77467b181179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811796 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387933.728913:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082214336, rc 0) 00000100:00100000:2.0:1787387933.728977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8cf376d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971805056:12345-0@lo:101: Request processed in 146us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.728984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787387933.729129:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805056:0@lo:101: 00010000:00010000:1.0:1787387933.729145:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.729153:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.729213:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805184:0@lo:256: 00000100:00100000:1.0:1787387933.729252:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.729343:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000705d770a going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.729397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805184 00000100:00100000:3.0:1787387933.729403:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805184 00000100:00100000:3.0:1787387933.729552:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387933.729560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1893c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971805184:12345-0@lo:256: 20000000:01000000:3.0:1787387933.729573:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387933.729590:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387933.729593:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787387933.729665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1893c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971805184:12345-0@lo:256: Request processed in 106us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387933.729672:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787387933.729849:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805184:0@lo:256: 10000000:01000000:1.0:1787387933.729904:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787387933.729916:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.729924:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 0000000071dd35ad/0x5cb77467b1811796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387933.729932:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787387933.729934:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787387933.729937:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387933.729967:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.729974:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.729982:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.729993:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805312:0@lo:101: 00000100:00100000:1.0:1787387933.730019:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.730045:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000705d770a going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.730142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805312 00000100:00100000:3.0:1787387933.730147:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805312 00000100:00100000:3.0:1787387933.730176:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387933.730182:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a63e280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971805312:12345-0@lo:101: 00010000:00010000:3.0:1787387933.730189:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387933.730198:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d10be93/0x5cb77467b18117ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18117a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387933.730211:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d10be93/0x5cb77467b18117ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387933.730229:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d10be93/0x5cb77467b18117ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387933.730236:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d10be93, rc 0) 00000100:00100000:3.0:1787387933.730262:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a63e280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971805312:12345-0@lo:101: Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387933.730268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787387933.730428:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805312:0@lo:101: 00010000:00010000:1.0:1787387933.730439:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.730446:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.730558:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805440:0@lo:501: 00000100:00100000:1.0:1787387933.730594:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.730616:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000705d770a going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.730655:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805440 00000100:00100000:3.0:1787387933.730659:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805440 00000100:00100000:3.0:1787387933.730707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387933.730715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039bbc5c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971805440:12345-0@lo:501: 00000100:00100000:3.0:1787387933.730835:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039bbc5c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971805440:12345-0@lo:501: Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387933.730841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787387933.731028:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805440:0@lo:501: 00000100:00100000:1.0:1787387933.731058:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805568:0@lo:503: 00000100:00100000:1.0:1787387933.731096:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.731124:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000705d770a going to sleep for 11 seconds 00000100:00100000:2.0:1787387933.731182:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805568 00000100:00100000:2.0:1787387933.731187:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805568 00000100:00100000:2.0:1787387933.731215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787387933.731221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040442487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971805568:12345-0@lo:503: 00000100:00100000:2.0:1787387933.731292:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040442487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971805568:12345-0@lo:503: Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.731299:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787387933.731385:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971805568:0@lo:503: 00000100:00100000:0.0:1787387933.732178:0:7925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7925:1874211971805696:0@lo:502: 00000100:00100000:0.0:1787387933.732224:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.732254:0:7925:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bed38b3d going to sleep for 11 seconds 00000100:00100000:2.0:1787387933.732302:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805696 00000100:00100000:2.0:1787387933.732307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805696 00000100:00100000:2.0:1787387933.732374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387933.732380:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034cdeeb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7925:x1874211971805696:12345-0@lo:502: 00000100:00100000:2.0:1787387933.732477:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034cdeeb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7925:x1874211971805696:12345-0@lo:502: Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.732486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787387933.732556:0:7925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7925:1874211971805696:0@lo:502: 00000020:01000000:0.0:1787387933.732583:0:7925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387933.732593:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387933.732595:0:7925:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787387933.732600:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787387933.732603:0:7925:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:00000080:0.0:1787387933.732624:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387933.732643:0:7925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000008cff9f07) 00000020:00000080:0.0:1787387933.732664:0:7925:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1787387933.732671:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787387933.732779:0:7925:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787387933.732784:0:7925:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787387933.732790:0:7925:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b18117b9 00010000:00080000:0.0:1787387933.732817:0:7925:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067a327bc@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:0.0:1787387933.734448:0:7925:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787387933.764429:0:7925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787387933.764446:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787387933.764549:0:7925:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787387933.764575:0:7925:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b18117c0 00000100:00080000:1.0:1787387933.764586:0:7925:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387933.764591:0:7925:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000067a327bc using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787387933.764631:0:7925:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f9e9cc7 x1874211971805824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787387933.764661:0:7925:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787387933.764747:0:7925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787387933.764878:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971805824:0@lo:38: 00000100:00100000:2.0:1787387933.765203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.765373:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805824 00000100:00100000:2.0:1787387933.765381:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805824 00000100:00100000:2.0:1787387933.765413:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387933.765419:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e0aa74c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971805824:12345-0@lo:38: 00010000:00080000:2.0:1787387933.765443:0:6525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1787387933.765550:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b18117c7 00000004:00100000:2.0:1787387933.765564:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787387933.765569:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787387933.765857:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d453a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971806080:0@lo:400: 00000100:00100000:1.0:1787387933.766071:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088757517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971805952:0@lo:400: 00000100:00100000:1.0:1787387933.766111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387933.766557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.766568:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971805952 00000100:00100000:0.0:1787387933.766576:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971805952 00000100:00100000:3.0:1787387933.766591:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000023d10789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971806208:0@lo:400: 00000100:00100000:0.0:1787387933.766625:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387933.766626:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.766639:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f293931 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971805952:12345-0@lo:400: 00000100:00100000:0.0:1787387933.766729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f293931 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971805952:12345-0@lo:400: Request processed in 94us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.766749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387933.766766:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806208 00000100:00100000:0.0:1787387933.766769:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806208 00000100:00100000:0.0:1787387933.766786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387933.766791:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009b1e769 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971806208:12345-0@lo:400: 00000100:00100000:2.0:1787387933.767005:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787387933.767015:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787387933.767142:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806080 00000100:00100000:2.0:1787387933.767146:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806080 00000100:00100000:2.0:1787387933.767229:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387933.767236:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000995b5a4d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971806080:12345-0@lo:400: 00000100:00100000:0.0:1787387933.767290:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009b1e769 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971806208:12345-0@lo:400: Request processed in 498us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.767298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387933.767411:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000995b5a4d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971806080:12345-0@lo:400: Request processed in 175us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.767417:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387933.767515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d453a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971806080:0@lo:400: 00010000:00080000:3.0:1787387933.767663:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000023d10789 x1874211971806208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387933.767674:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000023d10789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971806208:0@lo:400: 00000100:00080000:0.0:1787387933.768089:0:7929:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000a20952bc x1874211971806336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387933.768100:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000e56f86 going to sleep for 0 seconds 00000020:01000000:0.0:1787387933.768180:0:7925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387933.768187:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387933.768195:0:7925:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787387933.768199:0:7925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387933.768203:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387933.768205:0:7925:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387933.768208:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387933.768210:0:7925:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787387933.768233:0:7925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006eb7f229 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7925:1874211971806464:0@lo:502: 00000100:00100000:0.0:1787387933.768287:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.768317:0:7925:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a87ab0d2 going to sleep for 11 seconds 00010000:00080000:3.0:1787387933.770063:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000088757517 x1874211971805952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387933.770079:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088757517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971805952:0@lo:400: 00000100:00100000:0.0:1787387933.774212:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806464 00000100:00100000:0.0:1787387933.774230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806464 00000100:00100000:0.0:1787387933.774306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787387933.774317:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dae33baa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7925:x1874211971806464:12345-0@lo:502: 00000100:00100000:0.0:1787387933.774522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dae33baa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:7925:x1874211971806464:12345-0@lo:502: Request processed in 207us (6235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.774532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787387933.774610:0:7925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006eb7f229 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7925:1874211971806464:0@lo:502: 00000020:01000000:0.0:1787387933.775036:0:7925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387933.775043:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387933.775046:0:7925:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387933.775050:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:0.0:1787387933.778130:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000aeeb77aa : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387933.778240:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e0aa74c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874211971805824:12345-0@lo:38: Request processed in 12813us (13030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.778251:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387933.780814:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387933.780832:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787387933.780841:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787387933.780847:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787387933.780865:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000067a327bc lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787387933.780891:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000000e56f86): req@00000000a20952bc x1874211971806336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387933.780907:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f9e9cc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971805824:0@lo:38: 00000100:00100000:0.0:1787387933.781009:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.781044:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000e56f86 going to sleep for 11 seconds 00000020:01000000:1.0:1787387933.781572:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787387933.781618:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787387933.781628:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.781639:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: 0000000013b3c3ae/0x5cb77467b18117a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387933.781664:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787387933.781666:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c9714000 from 1 10000000:01000000:1.0:1787387933.781669:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787387933.781722:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: 0000000074f149e5/0x5cb77467b18117ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.781730:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: 0000000074f149e5/0x5cb77467b18117ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.781751:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: 0000000074f149e5/0x5cb77467b18117ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.781770:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971806592:0@lo:101: 00000100:00100000:1.0:1787387933.781809:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.781845:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000073ff07c going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.782250:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806592 00000100:00100000:0.0:1787387933.782258:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806592 00000100:00100000:0.0:1787387933.782313:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787387933.782323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a54e2569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971806592:12345-0@lo:101: 00010000:00010000:0.0:1787387933.782338:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387933.782351:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d726033b/0x5cb77467b18117d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18117ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.782376:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d726033b/0x5cb77467b18117d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18117ce expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.782386:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d726033b/0x5cb77467b18117d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18117ce expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.782394:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d726033b, rc 0) 00000100:00100000:0.0:1787387933.782436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a54e2569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971806592:12345-0@lo:101: Request processed in 115us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.782443:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787387933.782567:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971806592:0@lo:101: 00010000:00010000:1.0:1787387933.782583:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: 0000000074f149e5/0x5cb77467b18117ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.782602:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: 0000000074f149e5/0x5cb77467b18117ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.782668:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971806720:0@lo:501: 00000100:00100000:1.0:1787387933.782726:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.782761:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000073ff07c going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.783491:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806720 00000100:00100000:0.0:1787387933.783499:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806720 00000100:00100000:0.0:1787387933.783554:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787387933.783561:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f345070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971806720:12345-0@lo:501: 00000100:00100000:0.0:1787387933.783743:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f345070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971806720:12345-0@lo:501: Request processed in 172us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.783751:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787387933.784638:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971806720:0@lo:501: 00000100:00100000:1.0:1787387933.784698:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971806848:0@lo:503: 00000100:00100000:1.0:1787387933.784769:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.784802:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000073ff07c going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.785032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806848 00000100:00100000:0.0:1787387933.785037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806848 00000100:00100000:0.0:1787387933.785074:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787387933.785081:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d95fec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971806848:12345-0@lo:503: 00000100:00100000:0.0:1787387933.785193:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d95fec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971806848:12345-0@lo:503: Request processed in 112us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.785210:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787387933.785225:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806336 00000100:00100000:2.0:1787387933.785230:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806336 00000100:00100000:2.0:1787387933.785259:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387933.785265:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eb7f229 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971806336:12345-0@lo:1000: 00000100:00100000:2.0:1787387933.785341:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eb7f229 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971806336:12345-0@lo:1000: Request processed in 75us (4332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.785348:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387933.785382:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971806336:0@lo:1000: 00000040:01000000:0.0:1787387933.785412:0:7929:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787387933.785443:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971806976:0@lo:1000: 00000100:00100000:0.0:1787387933.785476:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.785498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971806976 00000100:00100000:0.0:1787387933.785501:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971806976 00000100:00100000:0.0:1787387933.785537:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387933.785544:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec92ac42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971806976:12345-0@lo:1000: 00000100:00100000:1.0:1787387933.785554:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971806848:0@lo:503: 00000100:00100000:0.0:1787387933.785627:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec92ac42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971806976:12345-0@lo:1000: Request processed in 83us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.785633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387933.785647:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d7599f5 going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.785659:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971806976:0@lo:1000: 00000100:00100000:0.0:1787387933.785708:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971807104:0@lo:700: 00000100:00100000:0.0:1787387933.785732:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.785767:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b77cc2c3 going to sleep for 11 seconds 00000100:00100000:1.0:1787387933.785771:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7932:1874211971807232:0@lo:502: 00000100:00100000:1.0:1787387933.785803:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.785828:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set 0000000028b8a61a going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.786100:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971807232 00000100:00100000:0.0:1787387933.786105:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971807232 00000100:00100000:0.0:1787387933.786140:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787387933.786146:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002db9934d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:7932:x1874211971807232:12345-0@lo:502: 00000100:00100000:0.0:1787387933.786374:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002db9934d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:7932:x1874211971807232:12345-0@lo:502: Request processed in 227us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.786380:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787387933.787092:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971807104 00000100:00100000:0.0:1787387933.787100:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971807104 00000100:00100000:0.0:1787387933.787134:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387933.787141:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdff42f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971807104:12345-0@lo:700: 00000100:00100000:0.0:1787387933.787193:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdff42f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971807104:12345-0@lo:700: Request processed in 53us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.787199:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387933.787281:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e3a9722e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971807360:0@lo:41: 00000100:00100000:0.0:1787387933.787295:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971807104:0@lo:700: 00000100:00100000:2.0:1787387933.787314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.787343:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971807360 00000100:00100000:2.0:1787387933.787346:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971807360 00000100:00100000:2.0:1787387933.787369:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387933.787375:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f71b9bde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971807360:12345-0@lo:41: 00000004:00000024:2.0:1787387933.787394:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787387933.787425:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f71b9bde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971807360:12345-0@lo:41: Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.787430:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387933.787452:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a20952bc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971807488:0@lo:1000: 00000100:00100000:0.0:1787387933.787479:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.787493:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000e56f86 going to sleep for 11 seconds 00000100:00100000:1.0:1787387933.787668:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fb3a2cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7932:1874211971807232:0@lo:502: 00000020:01000000:1.0:1787387933.787713:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387933.787724:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387933.787727:0:7932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787387933.787744:0:7932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273c9714000 00000020:00000080:1.0:1787387933.787747:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787387933.787789:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7932:1874211971807616:0@lo:502: 00000100:00100000:1.0:1787387933.787829:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.787855:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387933.788564:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971807360:0@lo:41: 00000100:00100000:2.0:1787387933.788660:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971807488 00000100:00100000:2.0:1787387933.788667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971807488 00000100:00100000:2.0:1787387933.788725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387933.788743:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971807488:12345-0@lo:1000: 00000100:00100000:2.0:1787387933.788842:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971807488:12345-0@lo:1000: Request processed in 109us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.788849:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387933.789471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971807616 00000100:00100000:0.0:1787387933.789478:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971807616 00000100:00100000:0.0:1787387933.789511:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787387933.789518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:7932:x1874211971807616:12345-0@lo:502: 00000100:00100000:0.0:1787387933.789646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:7932:x1874211971807616:12345-0@lo:502: Request processed in 127us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.789653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787387933.791095:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971807488:0@lo:1000: 00000004:00080000:1.0:1787387933.791175:0:7929:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9273e76d66c0 with version 0 00000020:00100000:1.0:1787387933.791201:0:7929:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787387933.791210:0:7929:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9273d0f5e680 x1874211971807872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787387933.791231:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971807872:0@lo:1000: 00000100:00100000:1.0:1787387933.791279:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.791311:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387933.791343:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:7932:1874211971807616:0@lo:502: 00000020:01000000:1.0:1787387933.791370:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387933.791382:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387933.791384:0:7932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787387933.791389:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787387933.791639:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787387933.791666:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387933.791693:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.791706:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387933.791716:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787387933.791719:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9273d0f44d40 from 1 10000000:01000000:0.0:1787387933.791722:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787387933.791760:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.791768:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387933.791776:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387933.791788:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971808000:0@lo:101: 00000100:00100000:0.0:1787387933.791817:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.791863:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.792106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971807872 00000100:00100000:3.0:1787387933.792112:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971807872 00000100:00100000:3.0:1787387933.792265:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387933.792276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1874211971807872:12345-0@lo:1000: 00000100:00100000:1.0:1787387933.793750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808000 00000100:00100000:1.0:1787387933.793764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808000 00000100:00100000:1.0:1787387933.793814:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387933.793821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971808000:12345-0@lo:101: 00010000:00010000:1.0:1787387933.793834:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387933.793851:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18117dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.793876:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18117dc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.794709:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18117dc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.794721:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1485200, rc 0) 00000100:00100000:1.0:1787387933.794804:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971808000:12345-0@lo:101: Request processed in 983us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387933.794812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387933.794871:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971808000:0@lo:101: 00010000:00010000:1.0:1787387933.796049:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.796065:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387933.796141:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971808128:0@lo:501: 00000100:00100000:1.0:1787387933.796199:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387933.796232:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387933.796713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808128 00000100:00100000:0.0:1787387933.796720:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808128 00000100:00100000:0.0:1787387933.796770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387933.796778:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971808128:12345-0@lo:501: 00000100:00100000:0.0:1787387933.796855:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971808128:12345-0@lo:501: Request processed in 78us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387933.796862:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787387933.798143:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971808128:0@lo:501: 10000000:01000000:1.0:1787387933.798186:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787387933.798197:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387933.798207:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387933.802186:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787387933.802214:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787387933.803531:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7929:x1874211971807872:12345-0@lo:1000: Request processed in 11251us (12246us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787387933.803547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787387933.805081:0:7929:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787387933.805090:0:7929:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787387933.805108:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971807872:0@lo:1000: 00000100:00100000:3.0:1787387933.805208:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971808256:0@lo:1000: 00000100:00100000:3.0:1787387933.805272:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387933.805306:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d13c3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387933.805359:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808256 00000100:00100000:2.0:1787387933.805366:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808256 00000100:00100000:2.0:1787387933.805415:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387933.805430:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7929:x1874211971808256:12345-0@lo:1000: 00000100:00100000:2.0:1787387933.805526:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7929:x1874211971808256:12345-0@lo:1000: Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387933.805534:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387933.805564:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7929:1874211971808256:0@lo:1000: 00000040:00080000:0.0:1787387933.805583:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787387933.805613:0:7929:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9273c7d59cc0 with version 1 00000004:00080000:2.0:1787387933.805755:0:7926:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9273d0d5d900 version 1 rpc_version 1 00000020:00100000:2.0:1787387933.805773:0:7926:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787387933.805782:0:7926:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9273eedd0700 x1874211971808512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387933.805795:0:7926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7926:1874211971808512:0@lo:1000: 00000100:00100000:2.0:1787387933.805829:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387933.805850:0:7926:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ab5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387933.805893:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808512 00000100:00100000:3.0:1787387933.805898:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808512 00000100:00100000:3.0:1787387933.805925:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387933.805931:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7926:x1874211971808512:12345-0@lo:1000: 00000040:00080000:0.0:1787387933.809121:0:7929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787387933.809214:0:7929:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787387933.809219:0:7929:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1787387933.811112:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787387933.811701:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7926:x1874211971808512:12345-0@lo:1000: Request processed in 5742us (5844us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787387933.811715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1787387933.811825:0:7926:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787387933.811831:0:7926:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787387933.811849:0:7926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7926:1874211971808512:0@lo:1000: 00010000:00010000:1.0:1787387933.834626:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387934.860365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387935.239931:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387935.239959:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971808640:0@lo:41: 00000100:00100000:0.0:1787387935.240027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387935.240534:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808640 00000100:00100000:3.0:1787387935.240543:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808640 00000100:00100000:3.0:1787387935.240601:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387935.240611:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971808640:12345-0@lo:41: 00000004:00000024:3.0:1787387935.240648:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787387935.240728:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971808640:12345-0@lo:41: Request processed in 118us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387935.240737:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387935.241467:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971808640:0@lo:41: 00010000:00010000:2.0:1787387935.884281:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387936.903923:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387937.932742:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387938.825948:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971808768:0@lo:400: 00000100:00100000:3.0:1787387938.826023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387938.826068:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971809280:0@lo:400: 00000100:00100000:3.0:1787387938.826094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387938.826138:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387938.826144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971809152:0@lo:400: 00000100:00100000:3.0:1787387938.826171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387938.826201:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971808896:0@lo:400: 00000100:00100000:3.0:1787387938.826224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387938.826240:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387938.826246:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971809024:0@lo:400: 00000100:00100000:3.0:1787387938.826267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387938.826294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808768 00000100:00100000:3.0:1787387938.826302:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808768 00000100:00100000:3.0:1787387938.826352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787387938.826360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:3647:x1874211971808768:12345-0@lo:400: 00000100:00100000:3.0:1787387938.826408:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:3647:x1874211971808768:12345-0@lo:400: Request processed in 48us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387938.826416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787387938.826445:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809280 00000100:00100000:3.0:1787387938.826448:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809280 00000100:00100000:3.0:1787387938.826470:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809024 00000100:00100000:3.0:1787387938.826473:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809024 00000100:00100000:3.0:1787387938.826485:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387938.826491:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971809280:12345-0@lo:400: 00000100:00100000:3.0:1787387938.826524:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971809280:12345-0@lo:400: Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387938.826530:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387938.826541:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387938.826547:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971809024:12345-0@lo:400: 00000100:00100000:3.0:1787387938.826572:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971809024:12345-0@lo:400: Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387938.826584:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387938.826597:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809152 00000100:00100000:3.0:1787387938.826600:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809152 00000100:00100000:3.0:1787387938.826619:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971808896 00000100:00100000:3.0:1787387938.826621:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971808896 00000100:00100000:3.0:1787387938.826632:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387938.826653:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971809152:12345-0@lo:400: 00000100:00100000:3.0:1787387938.826705:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971809152:12345-0@lo:400: Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387938.826711:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387938.826721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387938.826726:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971808896:12345-0@lo:400: 00000100:00100000:3.0:1787387938.826748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971808896:12345-0@lo:400: Request processed in 23us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387938.826754:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787387938.826791:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273eecff100 x1874211971809152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387938.829904:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387938.829936:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971809408:0@lo:41: 00000100:00100000:2.0:1787387938.830016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387938.831089:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971809152:0@lo:400: 00000100:00100000:3.0:1787387938.831118:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971808768:0@lo:400: 00000100:00100000:3.0:1787387938.831130:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971809280:0@lo:400: 00000100:00100000:3.0:1787387938.831172:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809408 00000100:00100000:3.0:1787387938.831178:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809408 00000100:00100000:3.0:1787387938.831232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387938.831240:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971809408:12345-0@lo:41: 00000004:00000024:3.0:1787387938.831275:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787387938.831341:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971809408:12345-0@lo:41: Request processed in 101us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387938.831348:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387938.831380:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971809024:0@lo:400: 00010000:00080000:3.0:1787387938.831394:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273eecffb80 x1874211971808896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387938.831403:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971808896:0@lo:400: 00000100:00100000:0.0:1787387938.833514:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971809408:0@lo:41: 00010000:00010000:2.0:1787387938.958085:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387939.984075:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387940.361053:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971809536:0@lo:41: 00000100:00100000:2.0:1787387940.361143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387940.364745:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809536 00000100:00100000:2.0:1787387940.364763:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809536 00000100:00100000:2.0:1787387940.364822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387940.364847:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971809536:12345-0@lo:41: 00000004:00000024:2.0:1787387940.364885:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787387940.364952:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971809536:12345-0@lo:41: Request processed in 107us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387940.364959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387940.365498:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971809536:0@lo:41: 00010000:00010000:1.0:1787387940.999905:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387942.025117:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387943.050150:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787387943.067348:0:8428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387943.067352:0:8428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787387943.067354:0:8428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787387943.067482:0:8428:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9273eef18800 00000020:01000004:2.0:1787387943.067498:0:8428:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787387943.067510:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787387943.067524:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9273fb15cd40) 00000020:00000080:2.0:1787387943.067540:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787387943.112933:0:8428:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787387943.112982:0:8428:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787387943.142106:0:8428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787387943.144547:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787387943.144573:0:8428:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787387943.144587:0:8428:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5cb77467b18117f1 00000020:01000004:0.0:1787387943.144594:0:8428:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787387943.144617:0:8428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787387943.144621:0:8428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787387943.144627:0:8428:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787387943.144631:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787387943.144770:0:8428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9273eedf99c0) 00000020:00000080:0.0:1787387943.144795:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787387943.154391:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387943.154904:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787387943.154912:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787387943.158320:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787387943.158337:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787387943.160588:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387943.160599:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787387943.163366:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387943.163596:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787387943.163604:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787387943.170304:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787387943.170316:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787387943.221884:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387943.222115:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787387943.222122:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787387943.230143:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787387943.230165:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787387943.231582:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787387943.231596:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787387943.245799:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387943.246003:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787387943.246010:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787387943.251720:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787387943.251736:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787387943.367613:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387943.367846:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787387943.367852:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787387943.368965:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787387943.368975:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787387943.369381:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787387943.369413:0:8428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787387943.369419:0:8428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787387943.396141:0:8428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787387943.396185:0:8428:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.152@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787387943.396190:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787387943.396192:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387943.396194:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387943.396195:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387943.396196:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387943.396198:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387943.396203:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387943.396205:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387943.396206:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387943.396208:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387943.396209:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387943.396213:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787387943.396215:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387943.396216:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387943.396217:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387943.396218:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387943.396219:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387943.396220:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387943.396221:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387943.396222:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387943.396223:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387943.396224:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387943.396225:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387943.401034:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787387943.401101:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971809664:0@lo:253: 00000100:00100000:1.0:1787387943.401190:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.401257:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70180 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.401335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809664 00000100:00100000:2.0:1787387943.401344:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809664 00000100:00100000:2.0:1787387943.401402:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787387943.401412:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:8428:x1874211971809664:12345-0@lo:253: 20000000:01000000:2.0:1787387943.401441:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787387943.401471:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787387943.401476:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787387943.401479:0:6514:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787387943.401822:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387943.402001:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787387943.402017:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787387943.402035:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787387943.402041:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787387943.402054:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787387943.402070:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787387943.402158:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787387943.402174:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.152@tcp 20000000:01000000:2.0:1787387943.402176:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:2.0:1787387943.402190:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787387943.402196:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387943.402226:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787387943.402233:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:2.0:1787387943.402246:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787387943.402251:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787387943.402261:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787387943.402275:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787387943.402340:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787387943.402352:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.152@tcp 20000000:01000000:2.0:1787387943.402354:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:2.0:1787387943.402367:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787387943.402372:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387943.402385:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787387943.402389:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:2.0:1787387943.402401:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787387943.402406:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787387943.402418:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787387943.402443:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787387943.402834:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787387943.402846:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.152@tcp 20000000:01000000:2.0:1787387943.402847:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:2.0:1787387943.402859:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787387943.402865:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787387943.402877:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787387943.402882:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:2.0:1787387943.402894:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787387943.402898:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787387943.402909:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787387943.402923:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787387943.402935:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787387943.402937:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787387943.402942:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787387943.402984:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787387943.402987:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387943.403779:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387943.403836:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387943.403854:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787387943.404084:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1787387943.404108:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1787387943.404146:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1787387943.404167:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787387943.404169:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787387943.405014:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787387943.405054:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787387943.405072:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787387943.405249:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787387943.405271:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787387943.405283:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787387943.405291:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787387943.405293:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787387943.405924:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787387943.405948:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787387943.405962:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787387943.406109:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787387943.406128:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787387943.406144:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787387943.406152:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787387943.406154:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787387943.413637:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787387943.413970:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787387943.414005:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787387943.414022:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1787387943.414044:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787387943.414065:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414084:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414092:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811749 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414115:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811781 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414122:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414129:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18117dc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414138:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414182:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18117dc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414199:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18117dc expref: 17 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.414215:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971809792:0@lo:104: 00000100:00100000:0.0:1787387943.414285:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387943.414343:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414352:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.414361:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971809920:0@lo:104: 00000100:00100000:0.0:1787387943.414384:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387943.414407:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811781 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414423:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811781 expref: 17 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.414433:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971810048:0@lo:104: 00000100:00100000:0.0:1787387943.414455:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387943.414471:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811749 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414479:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811749 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.414487:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971810176:0@lo:104: 00000100:00100000:0.0:1787387943.414525:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387943.414566:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.414575:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.414584:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971810304:0@lo:104: 00000100:00100000:0.0:1787387943.414607:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.414618:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.414766:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809792 00000100:00100000:2.0:1787387943.414774:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809792 00000100:00100000:2.0:1787387943.414809:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971809920 00000100:00100000:2.0:1787387943.414811:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971809920 00000100:00100000:2.0:1787387943.414822:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810048 00000100:00100000:2.0:1787387943.414824:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810048 00000100:00100000:2.0:1787387943.414832:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810176 00000100:00100000:2.0:1787387943.414841:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810176 00000100:00100000:2.0:1787387943.414853:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810304 00000100:00100000:2.0:1787387943.414855:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810304 00000100:00100000:2.0:1787387943.414868:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387943.414877:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:6514:x1874211971809792:12345-0@lo:104: 00010000:00010000:2.0:1787387943.414890:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.414950:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387943.414956:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:6514:x1874211971809792:12345-0@lo:104: Request processed in 81us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.414963:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387943.414982:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387943.414988:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6514:x1874211971809920:12345-0@lo:104: 00010000:00010000:2.0:1787387943.414996:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415030:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387943.415035:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6514:x1874211971809920:12345-0@lo:104: Request processed in 48us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.415041:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387943.415053:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387943.415059:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6514:x1874211971810048:12345-0@lo:104: 00010000:00010000:2.0:1787387943.415066:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415093:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787387943.415098:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6514:x1874211971810048:12345-0@lo:104: Request processed in 40us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.415110:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387943.415122:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387943.415129:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6514:x1874211971810176:12345-0@lo:104: 00010000:00010000:2.0:1787387943.415137:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415175:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787387943.415183:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6514:x1874211971810176:12345-0@lo:104: Request processed in 53us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.415191:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387943.415203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387943.415209:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6514:x1874211971810304:12345-0@lo:104: 00010000:00010000:2.0:1787387943.415216:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415238:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787387943.415242:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6514:x1874211971810304:12345-0@lo:104: Request processed in 35us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.415247:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787387943.415262:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787387943.415268:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415274:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.415279:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415297:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.415304:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.415310:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.415337:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415343:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.415357:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415363:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafbc00/0x5cb77467b18117dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415376:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787387943.415379:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415384:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1484000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.415387:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415393:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.415399:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.415410:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.415423:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415429:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.415435:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415441:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1484000/0x5cb77467b18117a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415449:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787387943.415452:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415457:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1482800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.415460:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415466:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.415471:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.415475:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.415484:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415488:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.415503:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415508:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1482800/0x5cb77467b1811781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811788 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415517:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387943.415519:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415524:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152a200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.415527:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415533:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.415539:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.415554:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.415568:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415573:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.415578:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415583:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152a200/0x5cb77467b1811749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811750 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415592:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387943.415600:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415606:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1485000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.415609:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415616:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.415622:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.415627:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.415639:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415645:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.415649:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415655:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1485000/0x5cb77467b18116d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18116d9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.415668:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.415669:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.415671:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387943.415777:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971810432:0@lo:103: 00000100:00100000:3.0:1787387943.415813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.415848:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971810944:0@lo:103: 00000100:00100000:3.0:1787387943.415869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.415890:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387943.415896:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971810560:0@lo:103: 00000100:00100000:3.0:1787387943.415915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.415942:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971810688:0@lo:103: 00000100:00100000:3.0:1787387943.415964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.415980:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387943.415985:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971810816:0@lo:103: 00000100:00100000:3.0:1787387943.416009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.416044:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810432 00000100:00100000:3.0:1787387943.416050:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810432 00010000:00010000:3.0:1787387943.416074:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18117dc expref: 18 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.416089:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810944 00000100:00100000:3.0:1787387943.416092:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810944 00010000:00010000:3.0:1787387943.416102:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 19 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.416112:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810560 00000100:00100000:3.0:1787387943.416115:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810560 00010000:00010000:3.0:1787387943.416124:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 20 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.416133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810688 00000100:00100000:3.0:1787387943.416135:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810688 00010000:00010000:3.0:1787387943.416144:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811781 expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.416153:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971810816 00000100:00100000:3.0:1787387943.416155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971810816 00010000:00010000:3.0:1787387943.416165:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811749 expref: 22 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.416177:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387943.416183:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3646:x1874211971810432:12345-0@lo:103: 00010000:00010000:3.0:1787387943.416192:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.416196:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18117dc expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416206:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18117dc expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416231:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.416260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3646:x1874211971810432:12345-0@lo:103: Request processed in 78us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.416267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387943.416282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387943.416289:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971810944:12345-0@lo:103: 00010000:00010000:3.0:1787387943.416296:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.416301:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 21 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416309:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 21 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416318:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.416338:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971810944:12345-0@lo:103: Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.416343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387943.416354:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387943.416359:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3646:x1874211971810560:12345-0@lo:103: 00010000:00010000:3.0:1787387943.416366:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.416370:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 20 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416378:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 20 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416387:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.416413:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3646:x1874211971810560:12345-0@lo:103: Request processed in 54us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.416419:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387943.416431:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387943.416437:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3644:x1874211971810688:12345-0@lo:103: 00010000:00010000:3.0:1787387943.416443:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.416448:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811781 expref: 19 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416455:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811781 expref: 19 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416464:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.416486:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3644:x1874211971810688:12345-0@lo:103: Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.416492:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387943.416503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387943.416509:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:3644:x1874211971810816:12345-0@lo:103: 00010000:00010000:3.0:1787387943.416516:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.416520:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811749 expref: 18 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416528:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811749 expref: 18 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416540:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416559:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416580:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416587:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416593:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416599:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416605:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafac00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787387943.416609:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416617:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416626:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.416636:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.416660:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:3644:x1874211971810816:12345-0@lo:103: Request processed in 151us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.416666:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387943.416756:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971810816:0@lo:103: 00000100:00100000:3.0:1787387943.416765:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971810688:0@lo:103: 00000100:00100000:3.0:1787387943.416807:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971810560:0@lo:103: 00000100:00100000:3.0:1787387943.416825:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971810432:0@lo:103: 00000100:00100000:3.0:1787387943.416830:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971810944:0@lo:103: 00010000:00010000:1.0:1787387943.417024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387943.417031:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787387943.417040:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387943.417043:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eedc0000 from 30 10000000:01000000:1.0:1787387943.417047:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387943.417076:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.417086:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.417094:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.417108:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971811072:0@lo:101: 00000100:00100000:1.0:1787387943.417150:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.417182:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.417235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811072 00000100:00100000:3.0:1787387943.417240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811072 00000100:00100000:3.0:1787387943.417316:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387943.417324:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971811072:12345-0@lo:101: 00010000:00010000:3.0:1787387943.417335:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387943.417345:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811806 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.417362:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811806 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.417370:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811806 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.417378:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152b800, rc 0) 00000100:00100000:3.0:1787387943.417419:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971811072:12345-0@lo:101: Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.417425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787387943.417478:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971811072:0@lo:101: 00010000:00010000:2.0:1787387943.417490:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.417509:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.417579:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971811200:0@lo:501: 00000100:00100000:2.0:1787387943.417605:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387943.417713:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1485200/0x5cb77467b18117e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18117dc expref: 18 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.417724:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971809792:0@lo:104: 00010000:00010000:0.0:1787387943.417735:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152ba00/0x5cb77467b18117ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18117a4 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.417760:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971809920:0@lo:104: 00010000:00010000:0.0:1787387943.417771:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811781 expref: 16 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.417778:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971810048:0@lo:104: 00010000:00010000:0.0:1787387943.417786:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafba00/0x5cb77467b1811750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811749 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.417791:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971810176:0@lo:104: 00010000:00010000:0.0:1787387943.417799:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152bc00/0x5cb77467b18116d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18116d2 expref: 14 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.417806:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971810304:0@lo:104: 00010000:00010000:0.0:1787387943.417829:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.417837:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.417842:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.417847:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafac00/0x5cb77467b18117ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787387943.417856:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787387943.422817:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff180 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.432005:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811200 00000100:00100000:1.0:1787387943.432026:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811200 00000100:00100000:1.0:1787387943.432092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387943.432103:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971811200:12345-0@lo:501: 00000100:00100000:1.0:1787387943.432302:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971811200:12345-0@lo:501: Request processed in 200us (14695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.432311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787387943.432411:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971811200:0@lo:501: 00000100:00100000:2.0:1787387943.432462:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971811328:0@lo:503: 00000100:00100000:2.0:1787387943.432517:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.432562:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff180 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.432892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811328 00000100:00100000:1.0:1787387943.432897:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811328 00000100:00100000:1.0:1787387943.432919:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387943.432926:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971811328:12345-0@lo:503: 00000100:00100000:1.0:1787387943.433017:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:6517:x1874211971811328:12345-0@lo:503: Request processed in 91us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.433024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787387943.433100:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971811328:0@lo:503: 00000100:00100000:1.0:1787387943.433436:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8451:1874211971811456:0@lo:502: 00000100:00100000:1.0:1787387943.433476:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.433509:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.433564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811456 00000100:00100000:2.0:1787387943.433568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811456 00000100:00100000:2.0:1787387943.433588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387943.433594:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:8451:x1874211971811456:12345-0@lo:502: 00000100:00100000:2.0:1787387943.433716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:8451:x1874211971811456:12345-0@lo:502: Request processed in 121us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.433723:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387943.434032:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:8428:x1874211971809664:12345-0@lo:253: Request processed in 32621us (32841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.434040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787387943.434111:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971809664:0@lo:253: 10000000:01000000:0.0:1787387943.434131:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787387943.434134:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787387943.434136:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787387943.434137:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387943.434138:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787387943.434139:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387943.434140:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387943.434142:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387943.434144:0:8428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787387943.434145:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387943.434146:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787387943.434166:0:8428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9273eef18800 from lustre-OST0000 10000000:01000000:0.0:1787387943.434190:0:8428:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787387943.434193:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787387943.434202:0:8428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9273d0f44d40 local copy 10000000:01000000:0.0:1787387943.434206:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787387943.434234:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.434245:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.434255:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.434268:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811584:0@lo:101: 00000100:00100000:0.0:1787387943.434297:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.434319:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee57600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.434362:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811584 00000100:00100000:2.0:1787387943.434366:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811584 00000100:00100000:2.0:1787387943.434397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787387943.434404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+13:8428:x1874211971811584:12345-0@lo:101: 00010000:00010000:2.0:1787387943.434418:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387943.434430:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1483600/0x5cb77467b181181b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811814 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.434451:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1483600/0x5cb77467b181181b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811814 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.434461:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1483600/0x5cb77467b181181b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811814 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.434469:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1483600, rc 0) 00000100:00100000:2.0:1787387943.434498:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:8428:x1874211971811584:12345-0@lo:101: Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.434504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787387943.434571:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811584:0@lo:101: 00010000:00010000:0.0:1787387943.434596:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.434616:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.434720:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811712:0@lo:501: 00000100:00100000:0.0:1787387943.434744:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.434758:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee57600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.434772:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811712 00000100:00100000:0.0:1787387943.434775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811712 00000100:00100000:0.0:1787387943.434792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787387943.434798:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:8428:x1874211971811712:12345-0@lo:501: 00000100:00100000:0.0:1787387943.434849:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:8428:x1874211971811712:12345-0@lo:501: Request processed in 50us (103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387943.434856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787387943.434885:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811712:0@lo:501: 10000000:01000000:0.0:1787387943.434896:0:8428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787387943.434912:0:8428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787387943.434917:0:8428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.434926:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.434933:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.434947:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787387943.434977:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9273eef18800 10000000:01000000:0.0:1787387943.434981:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787387943.434987:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787387943.434990:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387943.434994:0:8428:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787387943.434996:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787387943.435011:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.435018:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.435025:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.435036:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811840:0@lo:101: 00000100:00100000:0.0:1787387943.435060:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.435074:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee57d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.435086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811840 00000100:00100000:0.0:1787387943.435089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811840 00000100:00100000:0.0:1787387943.435106:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387943.435111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:8428:x1874211971811840:12345-0@lo:101: 00010000:00010000:0.0:1787387943.435118:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387943.435125:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.435139:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811822 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.435147:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811822 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.435160:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafae00, rc 0) 00000100:00100000:0.0:1787387943.435188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971811840:12345-0@lo:101: Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.435194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387943.435224:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811840:0@lo:101: 00010000:00010000:0.0:1787387943.435232:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.435240:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.435283:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811968:0@lo:501: 00000100:00100000:0.0:1787387943.435304:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.435316:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee57d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.435327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971811968 00000100:00100000:0.0:1787387943.435330:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971811968 00000100:00100000:0.0:1787387943.435345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787387943.435350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971811968:12345-0@lo:501: 00000100:00100000:0.0:1787387943.435421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971811968:12345-0@lo:501: Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.435428:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787387943.435453:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971811968:0@lo:501: 00000100:00100000:0.0:1787387943.435474:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971812096:0@lo:503: 00000100:00100000:0.0:1787387943.435506:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.435519:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee57d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.435535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812096 00000100:00100000:0.0:1787387943.435539:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812096 00000100:00100000:0.0:1787387943.435571:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787387943.435577:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971812096:12345-0@lo:503: 00000100:00100000:0.0:1787387943.435646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971812096:12345-0@lo:503: Request processed in 69us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.435653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787387943.435708:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971812096:0@lo:503: 00000040:00080000:0.0:1787387943.435916:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387943.435976:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971812224:0@lo:502: 00000100:00100000:0.0:1787387943.436004:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.436021:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.436034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812224 00000100:00100000:0.0:1787387943.436037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812224 00000100:00100000:0.0:1787387943.436053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787387943.436058:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971812224:12345-0@lo:502: 00000100:00100000:0.0:1787387943.436127:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971812224:12345-0@lo:502: Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.436134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787387943.436166:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971812224:0@lo:502: 00000040:00080000:0.0:1787387943.436305:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787387943.436326:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787387943.436337:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787387943.436348:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787387943.436358:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787387943.436368:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787387943.436384:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971812352:0@lo:502: 00000100:00100000:0.0:1787387943.436417:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.436428:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.436439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812352 00000100:00100000:0.0:1787387943.436442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812352 00000100:00100000:0.0:1787387943.436457:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787387943.436462:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971812352:12345-0@lo:502: 00000100:00100000:0.0:1787387943.436513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8428:x1874211971812352:12345-0@lo:502: Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.436520:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787387943.436568:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971812352:0@lo:502: 00000040:00080000:0.0:1787387943.436603:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787387943.436610:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:2.0:1787387943.437014:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387943.437022:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437031:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa600 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.437036:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437046:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.437053:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.437059:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.437084:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437096:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.437121:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437129:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafa600/0x5cb77467b1811814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b181181b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437143:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.437144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.437146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387943.437223:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8451:1874211971811456:0@lo:502: 00000100:00100000:1.0:1787387943.437268:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8451:1874211971812608:0@lo:502: 00000100:00100000:1.0:1787387943.437308:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.437343:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.437411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812608 00000100:00100000:2.0:1787387943.437416:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812608 00000100:00100000:2.0:1787387943.437454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787387943.437461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8451:x1874211971812608:12345-0@lo:502: 00000100:00100000:2.0:1787387943.437537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8451:x1874211971812608:12345-0@lo:502: Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.437554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787387943.437722:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8451:1874211971812608:0@lo:502: 00000040:00080000:1.0:1787387943.437741:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787387943.437889:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787387943.437909:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387943.437916:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437926:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.437936:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787387943.437938:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787387943.437941:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787387943.437970:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437978:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.437987:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.437999:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971812736:0@lo:101: 00000100:00100000:2.0:1787387943.438029:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.438052:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ffc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.438093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812736 00000100:00100000:1.0:1787387943.438102:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812736 00000100:00100000:1.0:1787387943.438134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787387943.438140:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971812736:12345-0@lo:101: 00010000:00010000:1.0:1787387943.438148:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387943.438159:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.438177:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811830 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.438186:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811830 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.438194:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b5000, rc 0) 00000100:00100000:1.0:1787387943.438226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971812736:12345-0@lo:101: Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.438231:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787387943.438261:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971812736:0@lo:101: 00010000:00010000:1.0:1787387943.438272:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.438280:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.438325:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971812864:0@lo:501: 00000100:00100000:1.0:1787387943.438351:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.438364:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.438374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812864 00000100:00100000:1.0:1787387943.438377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812864 00000100:00100000:1.0:1787387943.438398:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387943.438403:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971812864:12345-0@lo:501: 00000100:00100000:1.0:1787387943.438493:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971812864:12345-0@lo:501: Request processed in 89us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.438500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387943.438524:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971812864:0@lo:501: 00000100:00100000:1.0:1787387943.438558:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971812992:0@lo:503: 00000100:00100000:1.0:1787387943.438602:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.438615:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.438626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812992 00000100:00100000:1.0:1787387943.438629:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812992 00000100:00100000:1.0:1787387943.438644:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787387943.438650:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971812992:12345-0@lo:503: 00000100:00100000:1.0:1787387943.438756:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971812992:12345-0@lo:503: Request processed in 105us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.438762:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787387943.438798:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971812992:0@lo:503: 00000100:00100000:1.0:1787387943.438993:0:8453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8453:1874211971813120:0@lo:502: 00000100:00100000:1.0:1787387943.439029:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.439048:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813120 00000100:00100000:1.0:1787387943.439052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813120 00000100:00100000:1.0:1787387943.439069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787387943.439074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:8453:x1874211971813120:12345-0@lo:502: 00000100:00100000:1.0:1787387943.439145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:8453:x1874211971813120:12345-0@lo:502: Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.439161:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787387943.439189:0:8453:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.439200:0:8453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8453:1874211971813120:0@lo:502: 00000020:01000000:1.0:1787387943.439221:0:8453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787387943.439227:0:8453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787387943.439233:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.439236:0:8453:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787387943.439240:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787387943.439244:0:8453:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:1.0:1787387943.439266:0:8453:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787387943.439268:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387943.439283:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9273ef9f0000) 00000020:00000080:1.0:1787387943.439305:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787387943.439311:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787387943.439388:0:8453:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787387943.439395:0:8453:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787387943.439403:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1811845 00010000:00080000:1.0:1787387943.439432:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c20d4000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:1.0:1787387943.439664:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-5 is initialized 00000100:00100000:2.0:1787387943.440743:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971812480:0@lo:103: 00000100:00100000:2.0:1787387943.440800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.441162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971812480 00000100:00100000:3.0:1787387943.441170:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971812480 00000100:00100000:3.0:1787387943.441220:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387943.441229:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:3647:x1874211971812480:12345-0@lo:103: 00010000:00010000:3.0:1787387943.441242:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.441260:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1483600/0x5cb77467b181181b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811814 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.441289:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.441335:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3647:x1874211971812480:12345-0@lo:103: Request processed in 107us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.441342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387943.441448:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971812480:0@lo:103: 00000020:01000000:3.0:1787387943.442024:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787387943.442033:0:8452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787387943.442040:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387943.442043:0:8452:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787387943.442048:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787387943.442063:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9273d0f43380) 00000020:00000080:3.0:1787387943.442089:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787387943.442095:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787387943.442194:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273eef18800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787387943.442202:0:8452:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787387943.442209:0:8452:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5cb77467b1811853 00010000:00010000:3.0:1787387943.451292:0:8452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787387943.451623:0:8452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000040:01000000:1.0:1787387943.452189:0:8453:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787387943.452210:0:8453:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787387943.452372:0:8453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387943.452610:0:8453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387943.452743:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787387943.452830:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787387943.453365:0:8454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787387943.453371:0:8454:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787387943.454082:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787387943.454094:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787387943.454133:0:8453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787387943.454158:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b181185a 00000100:00080000:2.0:1787387943.454170:0:8453:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387943.454177:0:8453:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9272c20d4000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787387943.454217:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273eedd0e00 x1874211971813248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387943.454241:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787387943.454361:0:8453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387943.454366:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.454368:0:8453:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787387943.454371:0:8453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387943.454375:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.454376:0:8453:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387943.454379:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387943.454386:0:8453:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787387943.454416:0:8453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8453:1874211971813376:0@lo:502: 00000100:00100000:2.0:1787387943.454503:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.454542:0:8453:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.455095:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971813248:0@lo:8: 00000100:00100000:0.0:1787387943.455136:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.455780:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813248 00000100:00100000:2.0:1787387943.455787:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813248 00000100:00100000:2.0:1787387943.455826:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387943.455833:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971813248:12345-0@lo:8: 00010000:02000000:2.0:1787387943.455852:0:8435:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (not set up) 00000100:00100000:0.0:1787387943.457779:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813376 00000100:00100000:0.0:1787387943.457791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813376 00000100:00100000:0.0:1787387943.457845:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787387943.457854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8453:x1874211971813376:12345-0@lo:502: 00000100:00100000:0.0:1787387943.458034:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:8453:x1874211971813376:12345-0@lo:502: Request processed in 180us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.458043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787387943.458123:0:8453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8453:1874211971813376:0@lo:502: 00000020:01000000:0.0:1787387943.458155:0:8453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387943.458163:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387943.458165:0:8453:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387943.458170:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1787387943.458232:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1787387943.458257:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787387943.458267:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.458278:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.458288:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387943.458291:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eedc0000 from 1 10000000:01000000:0.0:1787387943.458293:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387943.458324:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.458333:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.458342:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.458361:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971813504:0@lo:101: 00000100:00100000:0.0:1787387943.458396:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.458570:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.461881:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387943.461920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971813888:0@lo:400: 00000100:00100000:1.0:1787387943.461994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.462073:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971814016:0@lo:400: 00000100:00100000:1.0:1787387943.462111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.462594:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971813760:0@lo:400: 00000100:00100000:0.0:1787387943.462630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.462662:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387943.462669:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971813632:0@lo:400: 00000100:00100000:0.0:1787387943.462723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.462756:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814016 00000100:00100000:0.0:1787387943.462763:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814016 00000100:00100000:0.0:1787387943.462803:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813760 00000100:00100000:0.0:1787387943.462813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813760 00000100:00100000:0.0:1787387943.462831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387943.462838:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971814016:12345-0@lo:400: 00000100:00100000:0.0:1787387943.462893:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971814016:12345-0@lo:400: Request processed in 54us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.462901:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387943.462918:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387943.462924:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971813760:12345-0@lo:400: 00000100:00100000:0.0:1787387943.462953:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971813760:12345-0@lo:400: Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.462959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387943.462976:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813888 00000100:00100000:0.0:1787387943.462980:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813888 00000100:00100000:0.0:1787387943.463000:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813632 00000100:00100000:0.0:1787387943.463002:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813632 00000100:00100000:0.0:1787387943.463025:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387943.463032:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971813888:12345-0@lo:400: 00000100:00100000:0.0:1787387943.463064:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971813888:12345-0@lo:400: Request processed in 32us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.463070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387943.463080:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387943.463086:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971813632:12345-0@lo:400: 00000100:00100000:0.0:1787387943.463109:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971813632:12345-0@lo:400: Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.463115:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387943.463155:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971814016:0@lo:400: 00010000:00080000:0.0:1787387943.463167:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273d0f5ca80 x1874211971813888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387943.463186:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971813888:0@lo:400: 00010000:00080000:0.0:1787387943.463222:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273d0f5ce00 x1874211971813632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387943.463231:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971813632:0@lo:400: 00000100:00100000:0.0:1787387943.463241:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971813760:0@lo:400: 00000100:00100000:2.0:1787387943.463634:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971813248:12345-0@lo:8: Request processed in 7798us (8495us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787387943.463642:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387943.463786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971813504 00000100:00100000:2.0:1787387943.463791:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971813504 00000100:00100000:2.0:1787387943.463817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787387943.463823:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971813504:12345-0@lo:101: 00010000:00010000:2.0:1787387943.463833:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387943.463855:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811861 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.463885:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811861 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.463897:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811861 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.463908:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1482800, rc 0) 00000100:00100000:2.0:1787387943.463936:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971813504:12345-0@lo:101: Request processed in 114us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.463953:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787387943.465593:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c20d4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787387943.465604:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787387943.465609:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971813248:0@lo:8: 00000100:00100000:0.0:1787387943.465652:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971813504:0@lo:101: 00010000:00010000:0.0:1787387943.465671:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.465710:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.465780:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814144:0@lo:501: 00000100:00100000:0.0:1787387943.465828:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.465853:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.465936:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814144 00000100:00100000:2.0:1787387943.465943:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814144 00000100:00100000:2.0:1787387943.465988:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787387943.465996:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971814144:12345-0@lo:501: 00000100:00100000:2.0:1787387943.466195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971814144:12345-0@lo:501: Request processed in 198us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.466202:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787387943.466277:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814144:0@lo:501: 00000100:00100000:1.0:1787387943.466308:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814272:0@lo:503: 00000100:00100000:1.0:1787387943.466356:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.466378:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ab5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.466420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814272 00000100:00100000:2.0:1787387943.466424:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814272 00000100:00100000:2.0:1787387943.466447:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787387943.466453:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971814272:12345-0@lo:503: 00000100:00100000:2.0:1787387943.466620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971814272:12345-0@lo:503: Request processed in 166us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.466627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000001:00000004:3.0:1787387943.466802:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787387943.467287:0:8452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00000100:00100000:1.0:1787387943.473651:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814272:0@lo:503: 00000100:00100000:2.0:1787387943.474168:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8456:1874211971814400:0@lo:502: 00000100:00100000:2.0:1787387943.474248:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.474333:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ffa80 going to sleep for 11 seconds 00080000:10000000:3.0:1787387943.475717:0:8452:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787387943.475919:0:8452:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00000100:00100000:1.0:1787387943.477806:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814400 00000100:00100000:1.0:1787387943.477820:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814400 00000100:00100000:1.0:1787387943.477927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787387943.477938:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:8456:x1874211971814400:12345-0@lo:502: 00000100:00100000:1.0:1787387943.478711:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:8456:x1874211971814400:12345-0@lo:502: Request processed in 772us (4461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.478720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787387943.480828:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8456:1874211971814400:0@lo:502: 00000020:01000000:2.0:1787387943.480874:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387943.480889:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.480892:0:8456:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787387943.480899:0:8456:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273eedc0000 00000020:00000080:2.0:1787387943.480902:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387943.480944:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8456:1874211971814528:0@lo:502: 00000100:00100000:2.0:1787387943.481769:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.481832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814528 00000100:00100000:2.0:1787387943.481839:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814528 00000100:00100000:2.0:1787387943.481900:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787387943.481910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:8456:x1874211971814528:12345-0@lo:502: 00000100:00100000:2.0:1787387943.482134:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:8456:x1874211971814528:12345-0@lo:502: Request processed in 225us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.482142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787387943.482261:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.482279:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8456:1874211971814528:0@lo:502: 00000020:01000000:2.0:1787387943.482301:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387943.482308:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.482310:0:8456:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787387943.482314:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00080000:10000000:3.0:1787387943.483665:0:8452:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:01000000:0.0:1787387943.486173:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787387943.486216:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387943.486230:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486243:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.486267:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787387943.486270:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273c9714000 from 30 10000000:01000000:0.0:1787387943.486273:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387943.486310:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486319:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486329:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.486356:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814656:0@lo:101: 00000100:00100000:0.0:1787387943.486434:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.486477:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.486526:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814656 00000100:00100000:0.0:1787387943.486534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814656 00000100:00100000:0.0:1787387943.486599:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787387943.486608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971814656:12345-0@lo:101: 00010000:00010000:0.0:1787387943.486622:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387943.486636:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181186f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486659:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181186f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486670:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181186f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486710:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb800, rc 0) 00000100:00100000:0.0:1787387943.486751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971814656:12345-0@lo:101: Request processed in 143us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.486758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787387943.486807:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814656:0@lo:101: 00010000:00010000:0.0:1787387943.486820:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486829:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.486882:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814784:0@lo:501: 00000100:00100000:0.0:1787387943.486905:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.486919:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.486930:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814784 00000100:00100000:0.0:1787387943.486934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814784 00000100:00100000:0.0:1787387943.486959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787387943.486965:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971814784:12345-0@lo:501: 00000100:00100000:0.0:1787387943.487087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971814784:12345-0@lo:501: Request processed in 121us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.487095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787387943.487122:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814784:0@lo:501: 00000100:00100000:0.0:1787387943.487147:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814912:0@lo:503: 00000100:00100000:0.0:1787387943.487187:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.487199:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.487218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971814912 00000100:00100000:0.0:1787387943.487221:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971814912 00000100:00100000:0.0:1787387943.487243:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787387943.487249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971814912:12345-0@lo:503: 00000100:00100000:0.0:1787387943.487322:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971814912:12345-0@lo:503: Request processed in 72us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.487328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787387943.487360:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971814912:0@lo:503: 00000100:00100000:2.0:1787387943.487857:0:8458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8458:1874211971815040:0@lo:502: 00000100:00100000:2.0:1787387943.487902:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.487918:0:8458:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff480 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.488123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815040 00000100:00100000:0.0:1787387943.488128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815040 00000100:00100000:0.0:1787387943.488165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787387943.488172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:8458:x1874211971815040:12345-0@lo:502: 00000100:00100000:0.0:1787387943.488277:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:8458:x1874211971815040:12345-0@lo:502: Request processed in 105us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.488283:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787387943.488401:0:8458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8458:1874211971815040:0@lo:502: 00000100:00100000:3.0:1787387943.488444:0:8458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8458:1874211971815168:0@lo:502: 00000100:00100000:3.0:1787387943.488475:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.488505:0:8458:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.488551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815168 00000100:00100000:2.0:1787387943.488556:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815168 00000100:00100000:2.0:1787387943.488588:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787387943.488595:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:8458:x1874211971815168:12345-0@lo:502: 00000100:00100000:2.0:1787387943.488658:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:8458:x1874211971815168:12345-0@lo:502: Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.488665:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787387943.488768:0:8458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8458:1874211971815168:0@lo:502: 00000040:00080000:3.0:1787387943.488795:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787387943.488939:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787387943.488965:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387943.488974:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.488993:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.489002:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787387943.489005:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787387943.489008:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387943.489103:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.489111:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.489121:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.489133:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971815296:0@lo:101: 00000100:00100000:2.0:1787387943.489159:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.489188:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.489345:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815296 00000100:00100000:3.0:1787387943.489350:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815296 00000100:00100000:3.0:1787387943.489383:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787387943.489391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971815296:12345-0@lo:101: 00010000:00010000:3.0:1787387943.489400:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387943.489414:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181187d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.489435:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181187d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.489445:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181187d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.489453:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152a400, rc 0) 00000100:00100000:3.0:1787387943.489484:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971815296:12345-0@lo:101: Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.489490:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787387943.489521:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971815296:0@lo:101: 00010000:00010000:3.0:1787387943.489533:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.489541:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.489775:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971815424:0@lo:501: 00000100:00100000:3.0:1787387943.489802:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.489832:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.489886:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815424 00000100:00100000:2.0:1787387943.489890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815424 00000100:00100000:2.0:1787387943.489922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787387943.489929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971815424:12345-0@lo:501: 00000100:00100000:2.0:1787387943.490158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971815424:12345-0@lo:501: Request processed in 228us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.490165:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787387943.490233:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971815424:0@lo:501: 00000100:00100000:3.0:1787387943.490261:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971815552:0@lo:503: 00000100:00100000:3.0:1787387943.490299:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.490323:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.490335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815552 00000100:00100000:3.0:1787387943.490339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815552 00000100:00100000:3.0:1787387943.490363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787387943.490369:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971815552:12345-0@lo:503: 00000100:00100000:3.0:1787387943.490444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971815552:12345-0@lo:503: Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.490451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787387943.490489:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971815552:0@lo:503: 00000100:00100000:2.0:1787387943.491146:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8460:1874211971815680:0@lo:502: 00000100:00100000:2.0:1787387943.491192:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.491226:0:8460:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff480 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.491363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815680 00000100:00100000:0.0:1787387943.491369:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815680 00000100:00100000:0.0:1787387943.491406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787387943.491414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:8460:x1874211971815680:12345-0@lo:502: 00000100:00100000:0.0:1787387943.491522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:8460:x1874211971815680:12345-0@lo:502: Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.491530:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787387943.491793:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8460:1874211971815680:0@lo:502: 00000020:01000000:3.0:1787387943.491820:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787387943.491827:0:8460:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787387943.491834:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387943.491836:0:8460:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787387943.491841:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787387943.491845:0:8460:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:3.0:1787387943.491868:0:8460:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787387943.491871:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787387943.491889:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9273d0f40000) 00000020:00000080:3.0:1787387943.491914:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osp with refcount 2 00000020:00000080:3.0:1787387943.491919:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787387943.492082:0:8460:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787387943.492088:0:8460:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787387943.492101:0:8460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1811892 00010000:00080000:3.0:1787387943.492129:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c2371000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787387943.492387:0:8460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-6 is initialized 00000020:00000080:2.0:1787387943.496101:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787387943.496117:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387943.496125:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.496128:0:8452:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787387943.496132:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387943.496137:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.496138:0:8452:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387943.496141:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387943.496143:0:8452:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787387943.496175:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387943.496177:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.496179:0:8452:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387943.496181:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787387943.496516:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787387943.496557:0:8428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787387943.496572:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.496596:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.496605:0:8428:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eef18800 from 1 10000000:01000000:0.0:1787387943.496608:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387943.496652:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.496661:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.496671:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.496731:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971815808:0@lo:101: 00000100:00100000:0.0:1787387943.496814:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.496857:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.497119:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815808 00000100:00100000:2.0:1787387943.497127:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815808 00000100:00100000:2.0:1787387943.497174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787387943.497182:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:8428:x1874211971815808:12345-0@lo:101: 00010000:00010000:2.0:1787387943.497194:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387943.497207:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811899 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.497229:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811899 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.497239:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811899 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.497248:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1485000, rc 0) 00000100:00100000:2.0:1787387943.497357:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971815808:12345-0@lo:101: Request processed in 175us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.497365:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787387943.497449:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971815808:0@lo:101: 00010000:00010000:0.0:1787387943.497462:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.497472:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.497573:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971815936:0@lo:501: 00000100:00100000:0.0:1787387943.497600:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.497626:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.497716:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971815936 00000100:00100000:2.0:1787387943.497720:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971815936 00000100:00100000:2.0:1787387943.497745:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787387943.497751:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971815936:12345-0@lo:501: 00000100:00100000:2.0:1787387943.497843:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971815936:12345-0@lo:501: Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.497850:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787387943.497952:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971815936:0@lo:501: 00000100:00100000:1.0:1787387943.497983:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816064:0@lo:503: 00000100:00100000:1.0:1787387943.498860:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.498887:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff92740196c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.498989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816064 00000100:00100000:0.0:1787387943.498997:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816064 00000100:00100000:0.0:1787387943.499146:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787387943.499154:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816064:12345-0@lo:503: 00000100:00100000:0.0:1787387943.499271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816064:12345-0@lo:503: Request processed in 117us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.499279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787387943.499417:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816064:0@lo:503: 00000040:00080000:1.0:1787387943.499828:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387943.499918:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816192:0@lo:502: 00000100:00100000:1.0:1787387943.499967:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.499995:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff92740196c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.501288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816192 00000100:00100000:0.0:1787387943.501297:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816192 00000100:00100000:0.0:1787387943.501348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787387943.501357:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816192:12345-0@lo:502: 00000100:00100000:0.0:1787387943.501494:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816192:12345-0@lo:502: Request processed in 137us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.501501:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787387943.501627:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816192:0@lo:502: 00000040:00080000:1.0:1787387943.501909:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787387943.501946:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787387943.501974:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816320:0@lo:502: 00000100:00100000:1.0:1787387943.502092:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.503984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816320 00000100:00100000:3.0:1787387943.503998:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816320 00000100:00100000:0.0:1787387943.504659:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff92740196c600 going to sleep for 11 seconds 00000040:01000000:3.0:1787387943.509504:0:8460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787387943.509530:0:8460:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787387943.509955:0:8460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387943.510236:0:8460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387943.510328:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787387943.510420:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1787387943.510948:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787387943.510960:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816320:12345-0@lo:502: 00000100:00100000:0.0:1787387943.511131:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816320:12345-0@lo:502: Request processed in 173us (9039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.511139:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787387943.511208:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816320:0@lo:502: 00000040:00080000:0.0:1787387943.511279:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787387943.511289:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787387943.512199:0:8463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387943.512212:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.512214:0:8463:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787387943.512222:0:8463:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273eef18800 00000020:00000080:2.0:1787387943.512225:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787387943.512236:0:8463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387943.512238:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387943.512240:0:8463:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787387943.512242:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787387943.512363:0:8462:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387943.512368:0:8462:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:01000000:1.0:1787387943.512424:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787387943.512453:0:8428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787387943.512465:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.512478:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387943.512526:0:8428:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787387943.512529:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9273eef18800 10000000:01000000:1.0:1787387943.512533:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9273eef18800 10000000:01000000:1.0:1787387943.512537:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387943.512552:0:8428:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eef18800 from 1 10000000:01000000:1.0:1787387943.512555:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387943.512590:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.512599:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.512610:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.512635:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816448:0@lo:101: 00000100:00100000:1.0:1787387943.512789:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.512828:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff92740196cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.512951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816448 00000100:00100000:2.0:1787387943.512958:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816448 00000100:00100000:2.0:1787387943.513008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787387943.513172:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:8428:x1874211971816448:12345-0@lo:101: 00010000:00010000:2.0:1787387943.513185:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387943.513199:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18118a7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.513220:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.513238:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.513246:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1484000, rc 0) 00000100:00100000:2.0:1787387943.513291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:8428:x1874211971816448:12345-0@lo:101: Request processed in 122us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.513347:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816448:0@lo:101: 00010000:00010000:1.0:1787387943.513360:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.513369:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.513451:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816576:0@lo:501: 00000100:00100000:1.0:1787387943.513477:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.513497:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff92740196cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.513511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816576 00000100:00100000:1.0:1787387943.513515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816576 00000020:00000080:0.0:1787387943.514118:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787387943.514132:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787387943.514171:0:8460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787387943.514195:0:8460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b18118b5 00000100:00080000:0.0:1787387943.514209:0:8460:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787387943.514214:0:8460:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9272c2371000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787387943.514237:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c209c700 x1874211971816704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787387943.514256:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787387943.514322:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387943.514327:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387943.514328:0:8460:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787387943.514332:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387943.514335:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387943.514336:0:8460:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387943.514339:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387943.514342:0:8460:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787387943.514362:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8460:1874211971816832:0@lo:502: 00000100:00100000:0.0:1787387943.514416:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.514429:0:8460:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.514448:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971816704:0@lo:8: 00000100:00100000:0.0:1787387943.514473:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.514812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816832 00000100:00100000:3.0:1787387943.514817:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816832 00000100:00100000:3.0:1787387943.514843:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787387943.514850:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:8460:x1874211971816832:12345-0@lo:502: 00000100:00100000:3.0:1787387943.514983:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:8460:x1874211971816832:12345-0@lo:502: Request processed in 133us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.514992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787387943.517325:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8460:1874211971816832:0@lo:502: 00000020:01000000:0.0:1787387943.517384:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387943.517395:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387943.517399:0:8460:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387943.517404:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787387943.517640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000020:01000000:3.0:1787387943.517780:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787387943.517802:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787387943.517814:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.517825:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387943.517835:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787387943.517838:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9273d0f44d40 from 1 10000000:01000000:3.0:1787387943.517840:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787387943.517881:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.517889:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.517918:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.517940:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971816960:0@lo:101: 00000100:00100000:3.0:1787387943.518002:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.518059:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.518167:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816960 00000100:00100000:2.0:1787387943.518175:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816960 00000100:00100000:2.0:1787387943.518220:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787387943.518229:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971816960:12345-0@lo:101: 00010000:00010000:2.0:1787387943.518242:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387943.518270:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18118bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.518296:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18118bc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.518307:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18118bc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.518316:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:2.0:1787387943.518359:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971816960:12345-0@lo:101: Request processed in 131us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.518366:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787387943.518402:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971816960:0@lo:101: 00010000:00010000:2.0:1787387943.518415:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.518431:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.518489:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971817088:0@lo:501: 00000100:00100000:2.0:1787387943.518517:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.518531:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.518541:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817088 00000100:00100000:2.0:1787387943.518554:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817088 00000100:00100000:2.0:1787387943.518571:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787387943.518577:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971817088:12345-0@lo:501: 00000100:00100000:2.0:1787387943.518653:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971817088:12345-0@lo:501: Request processed in 75us (135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387943.518660:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787387943.518720:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971817088:0@lo:501: 10000000:01000000:2.0:1787387943.518742:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787387943.518749:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.518757:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.519225:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787387943.519238:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971816576:12345-0@lo:501: 00000100:00100000:1.0:1787387943.519369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971816576:12345-0@lo:501: Request processed in 133us (5889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.519376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787387943.519413:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971816704 00000100:00100000:1.0:1787387943.519417:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971816704 00000100:00100000:0.0:1787387943.519503:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971816576:0@lo:501: 00000100:00100000:0.0:1787387943.519538:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817216:0@lo:503: 00000100:00100000:0.0:1787387943.519593:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.519619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817216 00000100:00100000:0.0:1787387943.519622:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817216 00000100:00100000:0.0:1787387943.519654:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787387943.519660:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817216:12345-0@lo:503: 00000100:00100000:0.0:1787387943.519769:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817216:12345-0@lo:503: Request processed in 109us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.519776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787387943.519812:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.519823:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817216:0@lo:503: 00000100:00100000:1.0:1787387943.520113:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387943.520118:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874211971816704:12345-0@lo:8: 00000100:00100000:1.0:1787387943.520172:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874211971816704:12345-0@lo:8: Request processed in 52us (5697us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787387943.520179:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1787387943.520263:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387943.520331:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817344:0@lo:502: 00000100:00100000:0.0:1787387943.520363:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.520384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817344 00000100:00100000:0.0:1787387943.520389:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817344 00000100:00100000:0.0:1787387943.520407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787387943.520413:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817344:12345-0@lo:502: 00000100:00100000:0.0:1787387943.520483:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817344:12345-0@lo:502: Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.520490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787387943.520519:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.520532:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817344:0@lo:502: 00000040:00080000:0.0:1787387943.520737:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787387943.520764:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787387943.520779:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787387943.520793:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787387943.520804:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787387943.520816:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787387943.520827:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787387943.520838:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787387943.520863:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787387943.520877:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787387943.520889:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787387943.520903:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787387943.520917:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787387943.520932:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787387943.520946:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787387943.520961:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787387943.520974:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787387943.520988:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787387943.521003:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787387943.521372:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787387943.521390:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787387943.521400:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787387943.521412:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787387943.521425:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787387943.521438:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787387943.521452:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787387943.521464:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787387943.521476:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787387943.521487:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787387943.521499:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787387943.521512:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787387943.521524:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787387943.521537:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787387943.521561:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787387943.521574:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787387943.521599:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787387943.521614:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787387943.521645:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817472:0@lo:502: 00000100:00100000:0.0:1787387943.521786:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.521822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817472 00000100:00100000:0.0:1787387943.521833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817472 00000100:00100000:0.0:1787387943.521905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787387943.521913:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817472:12345-0@lo:502: 00000100:00100000:0.0:1787387943.522009:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817472:12345-0@lo:502: Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.522024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787387943.525576:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.525633:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817472:0@lo:502: 00000040:00080000:0.0:1787387943.525821:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787387943.525838:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787387943.526614:0:8465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787387943.526657:0:8465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9272c241cd40) 00000020:00000080:3.0:1787387943.526711:0:8465:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type lwp with refcount 2 00000020:01000004:3.0:1787387943.526876:0:8465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273eef18800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787387943.526880:0:8465:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273eef18800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787387943.526884:0:8465:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273eef18800 3 00010000:00080000:3.0:1787387943.526926:0:8465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c2426000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787387943.528593:0:8465:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-7 is initialized 00000020:00000080:3.0:1787387943.528735:0:8465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787387943.528787:0:8465:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787387943.528801:0:8465:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5cb77467b18118d1 00000100:00080000:3.0:1787387943.528812:0:8465:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387943.528819:0:8465:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9272c2426000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787387943.528873:0:8465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273eecfd500 x1874211971817600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387943.528890:0:8465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787387943.531628:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971817600:0@lo:38: 00000100:00100000:1.0:1787387943.531755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.531821:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387943.531828:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787387943.531832:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787387943.531836:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971816704:0@lo:8: 00000100:00100000:0.0:1787387943.531964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817600 00000100:00100000:0.0:1787387943.531971:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817600 00000100:00100000:0.0:1787387943.533114:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387943.533125:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874211971817600:12345-0@lo:38: 00010000:00080000:0.0:1787387943.533154:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1787387943.533186:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5cb77467b18118d8 00000004:00100000:0.0:1787387943.533202:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787387943.533229:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9273fd3b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387943.533288:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874211971817600:12345-0@lo:38: Request processed in 165us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.533296:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787387943.533357:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273eecfd500 x1874211971817600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387943.533368:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387943.533375:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787387943.533381:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787387943.533386:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387943.533394:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2426000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387943.533399:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971817600:0@lo:38: 00000020:01000004:2.0:1787387943.533665:0:8465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787387943.533699:0:8465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9273fb1599c0) 00000020:00000080:2.0:1787387943.533715:0:8465:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type lwp with refcount 2 00000020:01000004:2.0:1787387943.533853:0:8465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273eef18800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387943.533857:0:8465:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273eef18800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387943.533864:0:8465:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273eef18800 3 00010000:00080000:2.0:1787387943.533886:0:8465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273f5dc7800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.152@tcp at head 00010000:00010000:2.0:1787387943.540264:0:8465:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-8 is initialized 00000020:00000080:2.0:1787387943.540373:0:8465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787387943.540422:0:8465:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787387943.540436:0:8465:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5cb77467b18118e6 00000100:00080000:2.0:1787387943.540448:0:8465:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387943.540455:0:8465:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9273f5dc7800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787387943.540501:0:8465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273eedd1c00 x1874211971817728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387943.540527:0:8465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787387943.540864:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874211971817728:0@lo:38: 00000100:00100000:0.0:1787387943.540961:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.541216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817728 00000100:00100000:3.0:1787387943.541224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817728 00000100:00100000:3.0:1787387943.541262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387943.541270:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971817728:12345-0@lo:38: 00010000:00080000:3.0:1787387943.541296:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1787387943.541330:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5cb77467b18118ed 00000004:00100000:3.0:1787387943.541344:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787387943.541375:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9272c2427800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387943.541437:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874211971817728:12345-0@lo:38: Request processed in 167us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.541444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787387943.541556:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273eedd1c00 x1874211971817728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387943.541566:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387943.541573:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787387943.541580:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787387943.541584:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787387943.541587:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273f5dc7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787387943.541593:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874211971817728:0@lo:38: 00000040:00080000:0.0:1787387943.542199:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787387943.542343:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787387943.542375:0:8428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387943.542392:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.542403:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787387943.542460:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787387943.542462:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387943.542464:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387943.542465:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387943.542466:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387943.542467:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387943.542469:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387943.542470:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387943.542475:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387943.542476:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387943.542478:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387943.542481:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787387943.542483:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387943.542484:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387943.542485:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387943.542486:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387943.542487:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387943.542488:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387943.542489:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387943.542490:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387943.542490:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387943.542491:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387943.542492:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387943.542513:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787387943.542526:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817856:0@lo:253: 00000100:00100000:1.0:1787387943.542595:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.542623:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817856 00000100:00100000:1.0:1787387943.542628:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817856 00000100:00100000:1.0:1787387943.542658:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787387943.542666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817856:12345-0@lo:253: 20000000:01000000:1.0:1787387943.542708:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787387943.542725:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787387943.542863:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff92740196c6c0 going to sleep for 11 seconds 20000000:01000000:1.0:1787387943.545952:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787387943.545970:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787387943.546080:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787387943.546086:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787387943.546112:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.546131:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811773 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.546139:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811796 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.546147:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.546187:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811796 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.546202:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811796 expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.546217:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecff800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971817984:0@lo:104: 00000100:00100000:3.0:1787387943.546285:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.546342:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811773 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.546364:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811773 expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.546373:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971818112:0@lo:104: 00000100:00100000:3.0:1787387943.546393:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.546649:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:8428:x1874211971817856:12345-0@lo:253: Request processed in 3982us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.546659:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787387943.546755:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:8428:1874211971817856:0@lo:253: 10000000:01000000:1.0:1787387943.546767:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787387943.546770:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387943.546778:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387943.546779:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387943.546780:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387943.546782:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387943.546783:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387943.546785:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387943.546786:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387943.546788:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387943.546789:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387943.546791:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787387943.546810:0:8428:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787387943.546950:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787387943.546968:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.546998:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971817984 00000100:00100000:2.0:1787387943.547203:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818112 00000100:00100000:2.0:1787387943.547210:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818112 00000100:00100000:2.0:1787387943.547243:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387943.547252:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971818112:12345-0@lo:104: 00010000:00010000:2.0:1787387943.547265:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.547326:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387943.547332:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971818112:12345-0@lo:104: Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.547338:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787387943.547357:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387943.547363:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.547371:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152a000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387943.547375:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.547392:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.547398:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.547404:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.547436:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.547443:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.547461:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.547468:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181177a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.547481:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.547483:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.547485:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387943.547498:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971818240:0@lo:103: 00000100:00100000:0.0:1787387943.547610:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971817984 00000100:00100000:0.0:1787387943.547641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387943.547648:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273efbac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971817984:12345-0@lo:104: 00010000:00010000:0.0:1787387943.547656:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.547722:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787387943.547727:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273efbac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971817984:12345-0@lo:104: Request processed in 80us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.547733:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787387943.547771:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387943.547776:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.547783:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1484200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387943.547786:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.547793:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.547812:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.547817:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.547833:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.547839:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.547845:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.547852:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1484200/0x5cb77467b1811796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181179d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.547867:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.547869:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.547871:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387943.548238:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecff800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971817984:0@lo:104: 00000100:00100000:3.0:1787387943.548249:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971818112:0@lo:104: 00010000:00010000:3.0:1787387943.548269:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.548361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.548931:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387943.548942:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971818368:0@lo:103: 00000100:00100000:2.0:1787387943.548984:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.549318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818240 00000100:00100000:3.0:1787387943.549324:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818240 00010000:00010000:3.0:1787387943.549348:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811773 expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.549380:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818368 00000100:00100000:3.0:1787387943.549384:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818368 00010000:00010000:3.0:1787387943.549395:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811796 expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.549416:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387943.549424:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3644:x1874211971818240:12345-0@lo:103: 00010000:00010000:3.0:1787387943.549435:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.549440:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811773 expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549451:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811773 expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549477:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafbe00/0x5cb77467b181177a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811773 expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549491:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.549538:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3644:x1874211971818240:12345-0@lo:103: Request processed in 115us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.549554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387943.549571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387943.549578:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3644:x1874211971818368:12345-0@lo:103: 00010000:00010000:3.0:1787387943.549586:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.549590:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811796 expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549600:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811796 expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549610:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1482e00/0x5cb77467b181179d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811796 expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549621:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549630:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787387943.549644:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014318645s 00010000:00010000:3.0:1787387943.549649:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549667:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549674:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549701:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549707:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152ba00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787387943.549712:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549720:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549740:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549750:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.549774:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3644:x1874211971818368:12345-0@lo:103: Request processed in 196us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.549780:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787387943.549802:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549809:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.549816:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152ba00/0x5cb77467b18118f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.549859:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971818368:0@lo:103: 00000100:00100000:3.0:1787387943.549868:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971818240:0@lo:103: 00080000:10000000:0.0:1787387943.551973:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787387943.552351:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787387943.552569:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787387943.552768:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787387943.552979:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787387943.553252:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787387943.555658:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787387943.562420:0:8428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787387943.562431:0:8428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787387943.562475:0:8428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787387943.562522:0:8428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787387943.562568:0:8428:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787387943.562598:0:8428:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787387943.563489:0:8428:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787387943.563707:0:8428:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1787387943.946748:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387943.946781:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971818496:0@lo:41: 00000100:00100000:1.0:1787387943.946875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.950707:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818496 00000100:00100000:0.0:1787387943.950725:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818496 00000100:00100000:0.0:1787387943.950843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387943.950854:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971818496:12345-0@lo:41: 00000004:00000024:0.0:1787387943.950909:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787387943.951008:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971818496:12345-0@lo:41: Request processed in 155us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.951016:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387943.951116:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971818496:0@lo:41: 00010000:00010000:2.0:1787387944.073581:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787387944.515507:0:8521:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387944.515831:0:8521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787387945.098070:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387945.480038:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387945.480067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971818624:0@lo:41: 00000100:00100000:0.0:1787387945.480137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387945.480246:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818624 00000100:00100000:1.0:1787387945.480256:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818624 00000100:00100000:1.0:1787387945.480313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387945.480323:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971818624:12345-0@lo:41: 00000004:00000024:1.0:1787387945.480358:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787387945.480414:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971818624:12345-0@lo:41: Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387945.480423:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387945.480468:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971818624:0@lo:41: 00010000:00010000:0.0:1787387946.120587:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387947.144297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.173707:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387948.552053:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971818752:0@lo:400: 00000100:00100000:2.0:1787387948.552146:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.554515:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387948.554538:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971818880:0@lo:400: 00000100:00100000:2.0:1787387948.554610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.554672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818752 00000100:00100000:2.0:1787387948.554693:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818752 00000100:00100000:2.0:1787387948.554748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787387948.554758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3644:x1874211971818752:12345-0@lo:400: 00000100:00100000:2.0:1787387948.554813:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3644:x1874211971818752:12345-0@lo:400: Request processed in 57us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.554821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787387948.554864:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971818880 00000100:00100000:2.0:1787387948.554868:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971818880 00000100:00100000:2.0:1787387948.554895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387948.554902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971818880:12345-0@lo:400: 00000100:00100000:2.0:1787387948.554935:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971818880:12345-0@lo:400: Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.554940:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787387948.554977:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209f800 x1874211971818880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.554992:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971818880:0@lo:400: 00000100:00100000:2.0:1787387948.555014:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971818752:0@lo:400: 00000100:00100000:0.0:1787387948.556910:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387948.557149:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387948.557171:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971819136:0@lo:400: 00000100:00100000:1.0:1787387948.557238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.559760:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971819008:0@lo:400: 00000100:00100000:0.0:1787387948.559838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.559909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819136 00000100:00100000:0.0:1787387948.559917:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819136 00000100:00100000:0.0:1787387948.559975:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387948.559984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971819136:12345-0@lo:400: 00000100:00100000:0.0:1787387948.560045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971819136:12345-0@lo:400: Request processed in 61us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.560053:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787387948.560386:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819008 00000100:00100000:1.0:1787387948.560393:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819008 00000100:00100000:1.0:1787387948.560427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387948.560434:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971819008:12345-0@lo:400: 00000100:00100000:1.0:1787387948.560491:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971819008:12345-0@lo:400: Request processed in 57us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.560510:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787387948.562606:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787387948.562740:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971819264:0@lo:400: 00000100:00100000:1.0:1787387948.562810:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787387948.562857:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787387948.562861:0:36:0:(import.c:65:import_set_state_nolock()) ffff9272c20d4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787387948.562868:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 232 00000100:00080000:2.0:1787387948.562873:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787387948.562880:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9272c20d4000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787387948.562915:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273eedd3480 x1874211971819392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387948.562942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787387948.562946:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787387948.562948:0:36:0:(import.c:65:import_set_state_nolock()) ffff9272c2371000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787387948.562953:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9272c2371000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787387948.562965:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273eedd1880 x1874211971819520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387948.562994:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971819648:0@lo:400: 00000100:00100000:2.0:1787387948.563161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387948.563175:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971819392:0@lo:8: 00000100:00100000:2.0:1787387948.563210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819648 00000100:00100000:1.0:1787387948.563216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.563221:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819648 00000100:00100000:1.0:1787387948.563249:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971819520:0@lo:8: 00000100:00100000:1.0:1787387948.563274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.563295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387948.563307:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971819648:12345-0@lo:400: 00000100:00100000:1.0:1787387948.563328:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819392 00000100:00100000:1.0:1787387948.563333:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819392 00000100:00100000:1.0:1787387948.563356:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819520 00000100:00100000:1.0:1787387948.563359:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819520 00000100:00100000:1.0:1787387948.563374:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387948.563377:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971819648:12345-0@lo:400: Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.563383:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874211971819392:12345-0@lo:8: 00000100:00100000:2.0:1787387948.563393:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787387948.563414:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1787387948.563464:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b18118fb 00010000:00080000:2.0:1787387948.563479:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd2d80 x1874211971819648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.563495:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971819648:0@lo:400: 00002000:00100000:1.0:1787387948.563532:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9272c20d3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787387948.563538:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1787387948.563543:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787387948.563613:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787387948.563957:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387948.563978:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819264 00000100:00100000:2.0:1787387948.563984:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819264 00000100:00100000:2.0:1787387948.564021:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00002000:00080000:1.0:1787387948.564021:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:2.0:1787387948.564033:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971819264:12345-0@lo:400: 00000100:00080000:1.0:1787387948.564063:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9272c20d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387948.564112:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1874211971819392:12345-0@lo:8: Request processed in 730us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.564119:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387948.564134:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387948.564139:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874211971819520:12345-0@lo:8: 00010000:00080000:1.0:1787387948.564163:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1787387948.564180:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1811902 00002000:00100000:1.0:1787387948.564187:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9272c20d5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787387948.564190:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787387948.564192:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787387948.564221:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787387948.564234:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9272c20d0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387948.564262:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874211971819520:12345-0@lo:8: Request processed in 121us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.564268:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387948.564394:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971819264:12345-0@lo:400: Request processed in 361us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.564403:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387948.564437:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971819264:0@lo:400: 00000100:00100000:2.0:1787387948.564500:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971819008:0@lo:400: 00000100:00100000:2.0:1787387948.564512:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387948.564520:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971819776:0@lo:400: 00000100:00100000:2.0:1787387948.564550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787387948.564824:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd0e00 x1874211971819136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.564836:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971819136:0@lo:400: 00000100:00100000:0.0:1787387948.564860:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819776 00000100:00100000:0.0:1787387948.564864:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819776 00000100:00100000:0.0:1787387948.564900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387948.564907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971819776:12345-0@lo:400: 00000100:00100000:0.0:1787387948.564958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971819776:12345-0@lo:400: Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.564965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787387948.564981:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787387948.565854:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2710e00 x1874211971819776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787387948.565858:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd3480 x1874211971819392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.565879:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787387948.565880:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971819776:0@lo:400: 00000100:00080000:2.0:1787387948.565889:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787387948.565899:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787387948.565905:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787387948.565909:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c20d4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787387948.565930:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787387948.565939:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971819392:0@lo:8: 00000004:00080000:3.0:1787387948.565948:0:8454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1787387948.565981:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd1880 x1874211971819520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787387948.565997:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787387948.566002:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787387948.566006:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787387948.566008:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787387948.566024:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787387948.566029:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971819520:0@lo:8: 00000004:00080000:3.0:1787387948.566040:0:8454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 237550359357ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787387948.566048:0:8454:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1787387948.566067:0:8462:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787387948.566124:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237550443906ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787387948.566130:0:8462:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787387948.566408:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971819904:0@lo:700: 00000100:00100000:2.0:1787387948.566464:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.566492:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9274019a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387948.566566:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971819904 00000100:00100000:3.0:1787387948.566573:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971819904 00000100:00100000:3.0:1787387948.566621:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387948.566630:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8455:x1874211971819904:12345-0@lo:700: 00000100:00100000:3.0:1787387948.566662:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1874211971820032:0@lo:700: 00000100:00100000:3.0:1787387948.566720:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.566738:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387948.567151:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820032 00000100:00100000:2.0:1787387948.567157:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820032 00000100:00100000:2.0:1787387948.567188:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387948.567195:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1874211971820032:12345-0@lo:700: 00000100:00080000:0.0:1787387948.568378:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787387948.571153:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:1.0:1787387948.571154:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787387948.584605:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:2.0:1787387948.584801:0:8464:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787387948.584831:0:8464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971820288:0@lo:7: 00000100:00100000:2.0:1787387948.584904:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.584959:0:8464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9274019a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387948.584979:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971820160:0@lo:13: 00000100:00100000:2.0:1787387948.585005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.585375:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820160 00000100:00100000:3.0:1787387948.585384:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820160 00000100:00100000:3.0:1787387948.585458:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387948.585461:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820288 00000100:00100000:2.0:1787387948.585467:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820288 00000100:00100000:3.0:1787387948.585470:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971820160:12345-0@lo:13: 00002000:00000024:3.0:1787387948.585504:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787387948.585509:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387948.585530:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8464:x1874211971820288:12345-0@lo:7: 00000100:00100000:3.0:1787387948.585563:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971820160:12345-0@lo:13: Request processed in 96us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387948.585582:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787387948.585608:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787387948.592194:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787387948.592203:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787387948.592501:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8464:x1874211971820288:12345-0@lo:7: Request processed in 6968us (7592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.592512:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787387948.592572:0:8464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2711880 x1874211971820288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.592589:0:8464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971820288:0@lo:7: 00000004:00080000:2.0:1787387948.592604:0:8464:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787387948.592641:0:8464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971820416:0@lo:5: 00000100:00100000:2.0:1787387948.592676:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.592791:0:8464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9274019a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387948.592810:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820416 00000100:00100000:2.0:1787387948.592817:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820416 00000100:00100000:2.0:1787387948.592861:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387948.592870:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8464:x1874211971820416:12345-0@lo:5: 00002000:00080000:2.0:1787387948.592895:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787387948.592899:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1787387948.594269:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2710000 x1874211971820160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.594565:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971820160:0@lo:13: 00000100:00100000:1.0:1787387948.594663:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1874211971820032:12345-0@lo:700: Request processed in 27467us (27941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.594674:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787387948.594962:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eecfe680 x1874211971820032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.594973:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1874211971820032:0@lo:700: 40000000:02000000:2.0:1787387948.594986:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00080000:1.0:1787387948.605043:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787387948.605061:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787387948.605066:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787387948.605265:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8464:x1874211971820416:12345-0@lo:5: Request processed in 12390us (12583us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787387948.605283:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787387948.605349:0:8464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2711880 x1874211971820416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.605361:0:8464:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787387948.605380:0:8464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971820416:0@lo:5: 00000004:00080000:0.0:1787387948.605396:0:8464:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787387948.605462:0:8464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971820544:0@lo:700: 00000100:00100000:0.0:1787387948.605504:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.605549:0:8464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d06039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387948.605664:0:8444:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:2.0:1787387948.605673:0:8444:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:2.0:1787387948.605957:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820544 00000100:00100000:2.0:1787387948.605964:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820544 00000100:00100000:0.0:1787387948.606114:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387948.606124:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8464:x1874211971820544:12345-0@lo:700: 00000100:00100000:0.0:1787387948.615722:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8455:x1874211971819904:12345-0@lo:700: Request processed in 49041us (49206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.615739:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787387948.615803:0:8455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2710380 x1874211971819904/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.615821:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971819904:0@lo:700: 00000004:00080000:0.0:1787387948.626069:0:8455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787387948.626228:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971820800:0@lo:7: 00000100:00100000:0.0:1787387948.626499:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.626561:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603900 going to sleep for 11 seconds 00000100:00100000:0.0:1787387948.626586:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971820672:0@lo:13: 00000100:00100000:0.0:1787387948.626613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.626657:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820672 00000100:00100000:0.0:1787387948.626664:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820672 00000100:00100000:0.0:1787387948.626747:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387948.626757:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971820672:12345-0@lo:13: 00000100:00100000:2.0:1787387948.626779:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820800 00002000:00000024:0.0:1787387948.626780:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787387948.626786:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820800 00000100:00100000:2.0:1787387948.626822:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387948.626831:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971820672:12345-0@lo:13: Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.626833:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8455:x1874211971820800:12345-0@lo:7: 00000100:00100000:0.0:1787387948.626845:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787387948.626885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209ce00 x1874211971820672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.626905:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971820672:0@lo:13: 00000100:00100000:0.0:1787387948.634903:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8464:x1874211971820544:12345-0@lo:700: Request processed in 28770us (29387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.634918:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387948.635391:0:8464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209dc00 x1874211971820544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.635405:0:8464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971820544:0@lo:700: 00002000:00080000:2.0:1787387948.641380:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787387948.641389:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787387948.641501:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8455:x1874211971820800:12345-0@lo:7: Request processed in 14666us (14998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.641512:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787387948.641814:0:8455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209f100 x1874211971820800/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.641831:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971820800:0@lo:7: 00000004:00080000:0.0:1787387948.641845:0:8455:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787387948.641893:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971820928:0@lo:5: 00000100:00100000:0.0:1787387948.641929:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.641983:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387948.642504:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971820928 00000100:00100000:2.0:1787387948.642513:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971820928 00000100:00100000:2.0:1787387948.642860:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387948.642871:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8455:x1874211971820928:12345-0@lo:5: 00002000:00080000:2.0:1787387948.642898:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787387948.642965:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8455:x1874211971820928:12345-0@lo:5: Request processed in 97us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.642973:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787387948.643398:0:8455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209f100 x1874211971820928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.643411:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971820928:0@lo:5: 00000004:00080000:0.0:1787387948.643422:0:8455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787387948.643466:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971821056:0@lo:5: 00000100:00100000:0.0:1787387948.643498:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.648244:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603900 going to sleep for 11 seconds 00000100:00100000:1.0:1787387948.652598:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821056 00000100:00100000:1.0:1787387948.652617:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821056 00000100:00100000:1.0:1787387948.652693:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787387948.652704:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8455:x1874211971821056:12345-0@lo:5: 00002000:00080000:1.0:1787387948.652748:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787387948.654364:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8455:x1874211971821056:12345-0@lo:5: Request processed in 1656us (10859us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787387948.654376:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787387948.654581:0:8455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209f100 x1874211971821056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.654597:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8455:1874211971821056:0@lo:5: 00000004:00080000:1.0:1787387948.654611:0:8455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787387948.654653:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2347100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8455:1874211971821184:0@lo:900: 00000100:00100000:1.0:1787387948.654723:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387948.654762:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef58e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387948.654789:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821184 00000100:00100000:1.0:1787387948.654795:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821184 00000100:00100000:1.0:1787387948.654834:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387948.654842:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8455:x1874211971821184:12345-0@lo:900: 00000100:00100000:1.0:1787387948.654890:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8455:x1874211971821184:12345-0@lo:900: Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.654897:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387948.654932:0:8455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2347100 x1874211971821184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.654942:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2347100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8455:1874211971821184:0@lo:900: 00000004:02000040:1.0:1787387948.657729:0:8464:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1787387948.674611:0:8464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971821312:0@lo:5: 00000100:00100000:0.0:1787387948.677575:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.677718:0:8464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387948.682828:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821312 00000100:00100000:2.0:1787387948.682847:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821312 00000100:00100000:2.0:1787387948.682913:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387948.682924:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8464:x1874211971821312:12345-0@lo:5: 00002000:00080000:3.0:1787387948.690499:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787387948.690607:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787387948.694088:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8464:x1874211971821312:12345-0@lo:5: Request processed in 11159us (16513us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787387948.694102:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787387948.694366:0:8464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209c700 x1874211971821312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.694385:0:8464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8464:1874211971821312:0@lo:5: 00000004:00080000:1.0:1787387948.694402:0:8464:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1787387949.065148:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387949.065176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971821440:0@lo:41: 00000100:00100000:0.0:1787387949.065252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.065706:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821440 00000100:00100000:1.0:1787387949.065714:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821440 00000100:00100000:1.0:1787387949.065768:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387949.065777:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971821440:12345-0@lo:41: 00000004:00000024:1.0:1787387949.065813:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787387949.065886:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971821440:12345-0@lo:41: Request processed in 110us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387949.065894:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387949.067976:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971821440:0@lo:41: 00010000:00010000:1.0:1787387949.191893:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787387949.940446:0:8812:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787387950.217921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387950.600023:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387950.600052:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971821568:0@lo:41: 00000100:00100000:3.0:1787387950.600138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387950.600320:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821568 00000100:00100000:1.0:1787387950.600328:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821568 00000100:00100000:1.0:1787387950.600390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387950.600400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971821568:12345-0@lo:41: 00000004:00000024:1.0:1787387950.600453:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787387950.600512:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971821568:12345-0@lo:41: Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387950.600520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387950.600585:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971821568:0@lo:41: 00000020:00000004:1.0:1787387950.840660:0:8864:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387950.840910:0:8864:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787387951.128182:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787387951.128190:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273eedc0000 from 5 10000000:01000000:1.0:1787387951.128195:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787387951.128239:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.128250:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.128261:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387951.128301:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971821696:0@lo:101: 00000100:00100000:1.0:1787387951.128368:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387951.128423:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef59d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387951.128990:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821696 00000100:00100000:1.0:1787387951.129000:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821696 00000100:00100000:1.0:1787387951.129055:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787387951.129064:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971821696:12345-0@lo:101: 00010000:00010000:1.0:1787387951.129079:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387951.129095:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811909 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.129121:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811909 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.129132:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811909 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.129141:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4000, rc 0) 00000100:00100000:1.0:1787387951.129187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971821696:12345-0@lo:101: Request processed in 124us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387951.129194:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787387951.129488:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971821696:0@lo:101: 00010000:00010000:1.0:1787387951.129504:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.129514:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387951.129598:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971821824:0@lo:256: 00000100:00100000:1.0:1787387951.129637:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387951.129658:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef59d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387951.129673:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821824 00000100:00100000:1.0:1787387951.129701:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821824 00000100:00100000:1.0:1787387951.129727:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787387951.129734:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971821824:12345-0@lo:256: 20000000:01000000:1.0:1787387951.129749:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787387951.129767:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787387951.129771:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787387951.129852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971821824:12345-0@lo:256: Request processed in 117us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387951.129859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787387951.129893:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971821824:0@lo:256: 10000000:01000000:1.0:1787387951.129954:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787387951.129962:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.129972:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387951.129982:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787387951.129984:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c9714000 from 5 10000000:01000000:1.0:1787387951.129987:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787387951.130009:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130027:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130037:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387951.130050:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971821952:0@lo:101: 00000100:00100000:1.0:1787387951.130078:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387951.130091:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef59d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387951.130107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971821952 00000100:00100000:1.0:1787387951.130110:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971821952 00000100:00100000:1.0:1787387951.130132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787387951.130138:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971821952:12345-0@lo:101: 00010000:00010000:1.0:1787387951.130147:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387951.130156:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811917 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130171:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811917 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130180:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811917 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130188:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4400, rc 0) 00000100:00100000:1.0:1787387951.130216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971821952:12345-0@lo:101: Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387951.130222:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787387951.130252:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971821952:0@lo:101: 00010000:00010000:1.0:1787387951.130269:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130276:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387951.130311:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971822080:0@lo:256: 00000100:00100000:1.0:1787387951.130337:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387951.130349:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef59d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387951.130360:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822080 00000100:00100000:1.0:1787387951.130364:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822080 00000100:00100000:1.0:1787387951.130384:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787387951.130390:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971822080:12345-0@lo:256: 20000000:01000000:1.0:1787387951.130414:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787387951.130426:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787387951.130429:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787387951.130486:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971822080:12345-0@lo:256: Request processed in 95us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387951.130493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787387951.130521:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971822080:0@lo:256: 10000000:01000000:1.0:1787387951.130557:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787387951.130563:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387951.130570:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387951.239983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787387951.764081:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1787387951.764104:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787387952.264062:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387953.288425:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387953.672879:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387953.672904:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971822208:0@lo:13: 00000100:00100000:3.0:1787387953.673004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387953.673172:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822208 00000100:00100000:0.0:1787387953.673181:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822208 00000100:00100000:0.0:1787387953.673238:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387953.673248:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971822208:12345-0@lo:13: 00002000:00000024:0.0:1787387953.673277:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387953.673474:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387953.673485:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971822336:0@lo:13: 00000100:00100000:2.0:1787387953.673516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.673593:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971822720:0@lo:400: 00000100:00100000:2.0:1787387953.673620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.673639:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971823232:0@lo:400: 00000100:00100000:2.0:1787387953.673664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.673700:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787387953.673706:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971822592:0@lo:400: 00000100:00100000:2.0:1787387953.673726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.673741:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971823104:0@lo:400: 00000100:00100000:2.0:1787387953.673759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.673781:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822720 00000100:00100000:2.0:1787387953.673785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822720 00000100:00100000:2.0:1787387953.673814:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387953.673821:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971822720:12345-0@lo:400: 00000100:00100000:2.0:1787387953.673873:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971822720:12345-0@lo:400: Request processed in 39us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.673881:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387953.673904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823232 00000100:00100000:2.0:1787387953.673908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823232 00000100:00100000:2.0:1787387953.673931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822592 00000100:00100000:2.0:1787387953.673934:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822592 00000100:00100000:2.0:1787387953.673944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823104 00000100:00100000:2.0:1787387953.673946:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823104 00000100:00100000:2.0:1787387953.673961:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387953.673974:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971823232:12345-0@lo:400: 00000100:00100000:2.0:1787387953.674004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971823232:12345-0@lo:400: Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.674011:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387953.674022:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387953.674028:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971822592:12345-0@lo:400: 00000100:00100000:2.0:1787387953.674052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971822592:12345-0@lo:400: Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.674058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387953.674069:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787387953.674075:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971823104:12345-0@lo:400: 00000100:00100000:2.0:1787387953.674099:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971823104:12345-0@lo:400: Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.674104:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787387953.674127:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971822464:0@lo:400: 00000100:00100000:2.0:1787387953.674155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.674179:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971822976:0@lo:400: 00000100:00100000:2.0:1787387953.674199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.674217:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387953.674223:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971822848:0@lo:400: 00000100:00100000:2.0:1787387953.674244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.674267:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822464 00000100:00100000:2.0:1787387953.674270:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822464 00000100:00100000:2.0:1787387953.674298:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787387953.674304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3645:x1874211971822464:12345-0@lo:400: 00000100:00100000:2.0:1787387953.674338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3645:x1874211971822464:12345-0@lo:400: Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.674363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1787387953.674410:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2713b80 x1874211971822592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.674424:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971822592:0@lo:400: 00010000:00080000:2.0:1787387953.674435:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2712d80 x1874211971823104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.674441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971823104:0@lo:400: 00000100:00100000:2.0:1787387953.674449:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971822720:0@lo:400: 00010000:00080000:2.0:1787387953.674457:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2711c00 x1874211971823232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.674464:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971823232:0@lo:400: 00000100:00100000:2.0:1787387953.674493:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971822464:0@lo:400: 00000100:00100000:2.0:1787387953.674506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822848 00000100:00100000:2.0:1787387953.674509:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822848 00000100:00100000:2.0:1787387953.674523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387953.674528:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971822848:12345-0@lo:400: 00000100:00100000:2.0:1787387953.674558:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971822848:12345-0@lo:400: Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.674563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787387953.674583:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2713100 x1874211971822848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.674591:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971822848:0@lo:400: 00000100:00100000:2.0:1787387953.674618:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822976 00000100:00100000:2.0:1787387953.674627:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822976 00000100:00100000:2.0:1787387953.674647:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387953.674653:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971822976:12345-0@lo:400: 00000100:00100000:2.0:1787387953.674725:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971822976:12345-0@lo:400: Request processed in 70us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.674730:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387953.674753:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971822976:0@lo:400: 00000100:00100000:2.0:1787387953.674785:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787387953.674792:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:2.0:1787387953.674805:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387953.674809:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387953.674812:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387953.678218:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971822208:12345-0@lo:13: Request processed in 4960us (5202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387953.678235:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387953.678274:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971822336 00000100:00100000:0.0:1787387953.678290:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971822336 00000100:00100000:0.0:1787387953.678397:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387953.678405:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971822336:12345-0@lo:13: 00002000:00000024:0.0:1787387953.678431:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387953.678503:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971822336:12345-0@lo:13: Request processed in 99us (4986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387953.678509:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787387953.678649:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2710000 x1874211971822336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387953.678662:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787387953.678703:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971822336:0@lo:13: 00010000:00080000:3.0:1787387953.681032:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209c000 x1874211971822208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387953.681049:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787387953.681074:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971822208:0@lo:13: 00000100:00080000:2.0:1787387953.683102:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1787387953.789293:0:8966:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387953.789506:0:8966:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787387954.185901:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387954.185927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971823360:0@lo:41: 00000100:00100000:3.0:1787387954.186196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387954.186331:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823360 00000100:00100000:0.0:1787387954.186351:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823360 00000100:00100000:0.0:1787387954.186408:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787387954.186418:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971823360:12345-0@lo:41: 00000004:00000024:0.0:1787387954.186455:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787387954.186503:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971823360:12345-0@lo:41: Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387954.186511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787387954.186715:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971823360:0@lo:41: 00010000:00010000:2.0:1787387954.313720:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787387954.661142:0:9015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787387954.661153:0:9015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1787387955.337152:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387955.722388:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971823488:0@lo:41: 00000100:00100000:1.0:1787387955.722457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387955.722533:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823488 00000100:00100000:1.0:1787387955.722542:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823488 00000100:00100000:1.0:1787387955.722590:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387955.722599:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971823488:12345-0@lo:41: 00000004:00000024:1.0:1787387955.722647:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787387955.722713:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971823488:12345-0@lo:41: Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387955.722721:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387955.722767:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971823488:0@lo:41: 00010000:00010000:2.0:1787387956.360153:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387957.384398:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387958.412857:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387958.792236:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971823616:0@lo:400: 00000100:00100000:3.0:1787387958.792517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387958.792652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823616 00000100:00100000:1.0:1787387958.792662:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823616 00000100:00100000:1.0:1787387958.792835:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787387958.792844:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971823616:12345-0@lo:400: 00000100:00100000:2.0:1787387958.793488:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971823744:0@lo:400: 00000100:00100000:2.0:1787387958.793526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387958.793589:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823744 00000100:00100000:2.0:1787387958.793594:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823744 00000100:00100000:2.0:1787387958.793625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787387958.793632:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971823744:12345-0@lo:400: 00000100:00100000:2.0:1787387958.793669:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971823744:12345-0@lo:400: Request processed in 37us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.793676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787387958.793738:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209c000 x1874211971823744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387958.793768:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971823744:0@lo:400: 00000100:00100000:1.0:1787387958.794454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971823616:12345-0@lo:400: Request processed in 1606us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.794466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787387958.794509:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971823872:0@lo:13: 00000100:00100000:1.0:1787387958.794631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387958.794728:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387958.794735:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824000:0@lo:13: 00000100:00100000:1.0:1787387958.794760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.795105:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971823616:0@lo:400: 00000100:00100000:3.0:1787387958.795124:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971824128:0@lo:400: 00000100:00100000:3.0:1787387958.795184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.795215:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971824640:0@lo:400: 00000100:00100000:3.0:1787387958.795238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.795267:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787387958.795273:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971824256:0@lo:400: 00000100:00100000:3.0:1787387958.795295:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.795310:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971824768:0@lo:400: 00000100:00100000:3.0:1787387958.795342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.795371:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824128 00000100:00100000:3.0:1787387958.795376:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824128 00000100:00100000:3.0:1787387958.795414:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387958.795422:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971824128:12345-0@lo:400: 00000100:00100000:3.0:1787387958.795465:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971824128:12345-0@lo:400: Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387958.795472:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387958.795489:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824640 00000100:00100000:3.0:1787387958.795492:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824640 00000100:00100000:3.0:1787387958.795516:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824256 00000100:00100000:3.0:1787387958.795518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824256 00000100:00100000:3.0:1787387958.795528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824768 00000100:00100000:3.0:1787387958.795530:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824768 00000100:00100000:3.0:1787387958.795546:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387958.795817:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971824640:12345-0@lo:400: 00000100:00100000:3.0:1787387958.795852:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971824640:12345-0@lo:400: Request processed in 39us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387958.795859:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387958.795890:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387958.795896:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971824256:12345-0@lo:400: 00000100:00100000:3.0:1787387958.795945:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971824256:12345-0@lo:400: Request processed in 49us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387958.795951:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387958.795963:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387958.795969:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971824768:12345-0@lo:400: 00000100:00100000:3.0:1787387958.795991:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971824768:12345-0@lo:400: Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387958.795997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787387958.796027:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c209c000 x1874211971824256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387958.796039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971824256:0@lo:400: 00010000:00080000:3.0:1787387958.796048:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273d0f5ca80 x1874211971824768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387958.796057:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971824768:0@lo:400: 00000100:00100000:3.0:1787387958.796066:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971824128:0@lo:400: 00010000:00080000:3.0:1787387958.796074:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273d0f5ce00 x1874211971824640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387958.796082:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971824640:0@lo:400: 00000100:00100000:1.0:1787387958.801645:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824384:0@lo:400: 00000100:00100000:1.0:1787387958.801722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387958.801753:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387958.801760:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824512:0@lo:400: 00000100:00100000:1.0:1787387958.801784:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387958.801823:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824384 00000100:00100000:1.0:1787387958.801831:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824384 00000100:00100000:1.0:1787387958.802111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387958.802121:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824384:12345-0@lo:400: 00000100:00100000:1.0:1787387958.802176:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824384:12345-0@lo:400: Request processed in 55us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.802184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387958.802224:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824512 00000100:00100000:1.0:1787387958.802228:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824512 00000100:00100000:1.0:1787387958.802270:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387958.802276:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824512:12345-0@lo:400: 00000100:00100000:1.0:1787387958.802307:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824512:12345-0@lo:400: Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.802313:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787387958.802366:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273d0f5c700 x1874211971824512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387958.802381:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824512:0@lo:400: 00000100:00100000:1.0:1787387958.802390:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824384:0@lo:400: 00000100:00100000:2.0:1787387958.804476:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971823872 00000100:00100000:2.0:1787387958.804491:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971823872 00000100:00100000:2.0:1787387958.804624:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824000 00000100:00100000:2.0:1787387958.804627:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824000 00000100:00100000:2.0:1787387958.804648:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387958.804656:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971823872:12345-0@lo:13: 00002000:00000024:2.0:1787387958.804704:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387958.804782:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971823872:12345-0@lo:13: Request processed in 126us (10151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.804789:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787387958.804832:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd3800 x1874211971823872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387958.804854:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971823872:0@lo:13: 00000100:00100000:1.0:1787387958.805114:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387958.805123:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824000:12345-0@lo:13: 00002000:00000024:1.0:1787387958.805134:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387958.805165:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824000:12345-0@lo:13: Request processed in 43us (10404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.805182:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787387958.805302:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd1180 x1874211971824000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387958.805315:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824000:0@lo:13: 00000100:00080000:2.0:1787387958.805459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387958.805465:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387958.805468:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387959.304263:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824896:0@lo:41: 00000100:00100000:2.0:1787387959.304339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387959.304452:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971824896 00000100:00100000:1.0:1787387959.304461:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971824896 00000100:00100000:1.0:1787387959.304521:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787387959.304537:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824896:12345-0@lo:41: 00000004:00000024:1.0:1787387959.304600:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787387959.304655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971824896:12345-0@lo:41: Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387959.304668:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387959.306542:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971824896:0@lo:41: 00010000:00010000:0.0:1787387959.434972:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387960.461074:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387960.839858:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387960.840082:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971825024:0@lo:41: 00000100:00100000:1.0:1787387960.840150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387960.840214:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825024 00000100:00100000:1.0:1787387960.840221:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825024 00000100:00100000:1.0:1787387960.840265:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787387960.840273:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971825024:12345-0@lo:41: 00000004:00000024:1.0:1787387960.840301:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787387960.840373:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971825024:12345-0@lo:41: Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387960.840380:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787387960.840422:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971825024:0@lo:41: 00010000:00010000:0.0:1787387961.479860:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387962.507547:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387963.531980:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387963.912894:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971825152:0@lo:13: 00000100:00100000:2.0:1787387963.912984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387963.913198:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971825280:0@lo:13: 00000100:00100000:3.0:1787387963.913227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387963.913310:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825152 00000100:00100000:1.0:1787387963.913318:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825152 00000100:00100000:1.0:1787387963.913406:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825280 00000100:00100000:1.0:1787387963.913410:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825280 00000100:00100000:2.0:1787387963.913449:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387963.913459:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971825152:12345-0@lo:13: 00002000:00000024:2.0:1787387963.913489:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387963.913530:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971825152:12345-0@lo:13: Request processed in 73us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387963.913537:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787387963.913574:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd3800 x1874211971825152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387963.913589:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971825152:0@lo:13: 00000100:00100000:2.0:1787387963.913975:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971825536:0@lo:400: 00000100:00100000:2.0:1787387963.914006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387963.914025:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971826048:0@lo:400: 00000100:00100000:2.0:1787387963.914059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387963.914080:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787387963.914086:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971825408:0@lo:400: 00000100:00100000:2.0:1787387963.914112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387963.914134:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971825920:0@lo:400: 00000100:00100000:2.0:1787387963.914168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387963.914194:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825536 00000100:00100000:2.0:1787387963.914199:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825536 00000100:00100000:2.0:1787387963.914226:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826048 00000100:00100000:2.0:1787387963.914229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826048 00000100:00080000:3.0:1787387963.917266:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387963.917276:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387963.917304:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387963.917334:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971825536:12345-0@lo:400: 00000100:00100000:3.0:1787387963.918188:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971825536:12345-0@lo:400: Request processed in 857us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387963.918199:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387963.919920:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387963.919934:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971825280:12345-0@lo:13: 00002000:00000024:1.0:1787387963.919967:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387963.920033:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971825280:12345-0@lo:13: Request processed in 103us (6804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387963.920040:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387963.923757:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825920 00000100:00100000:1.0:1787387963.923768:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825920 00000100:00100000:1.0:1787387963.923838:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387963.923848:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971825920:12345-0@lo:400: 00000100:00100000:1.0:1787387963.923928:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971825920:12345-0@lo:400: Request processed in 82us (9759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387963.923936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387963.923960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825408 00000100:00100000:1.0:1787387963.923964:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825408 00000100:00100000:1.0:1787387963.923990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787387963.923996:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3645:x1874211971825408:12345-0@lo:400: 00000100:00100000:1.0:1787387963.924027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3645:x1874211971825408:12345-0@lo:400: Request processed in 31us (9914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387963.924033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787387963.924092:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971825792:0@lo:400: 00000100:00100000:1.0:1787387963.924123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787387963.924170:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eecfe680 x1874211971825280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387963.924189:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971825280:0@lo:13: 00000100:00100000:1.0:1787387963.924208:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787387963.924213:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971825664:0@lo:400: 00000100:00100000:1.0:1787387963.924235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387963.924258:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971826176:0@lo:400: 00000100:00100000:1.0:1787387963.924278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387963.924297:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825664 00000100:00100000:1.0:1787387963.924301:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825664 00000100:00100000:1.0:1787387963.924320:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387963.924325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971825664:12345-0@lo:400: 00000100:00100000:1.0:1787387963.924354:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971825664:12345-0@lo:400: Request processed in 29us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387963.924360:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387963.924382:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971825664:0@lo:400: 00010000:00080000:0.0:1787387963.924520:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2713100 x1874211971825536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387963.924534:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971825536:0@lo:400: 00000100:00100000:0.0:1787387963.924560:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971825408:0@lo:400: 00000100:00100000:0.0:1787387963.924570:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971825920:0@lo:400: 00000100:00100000:0.0:1787387963.925228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971825792 00000100:00100000:0.0:1787387963.925235:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971825792 00000100:00100000:0.0:1787387963.925263:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826176 00000100:00100000:0.0:1787387963.925267:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826176 00000100:00100000:0.0:1787387963.925303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387963.925310:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971825792:12345-0@lo:400: 00000100:00100000:0.0:1787387963.925367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971825792:12345-0@lo:400: Request processed in 57us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387963.925374:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387963.925388:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387963.925395:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971826176:12345-0@lo:400: 00000100:00100000:0.0:1787387963.925424:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971826176:12345-0@lo:400: Request processed in 31us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387963.925430:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787387963.925462:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2713b80 x1874211971826176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387963.925474:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971826176:0@lo:400: 00010000:00080000:0.0:1787387963.925485:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2711c00 x1874211971825792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387963.925493:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971825792:0@lo:400: 00000100:00100000:2.0:1787387963.925609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387963.925618:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971826048:12345-0@lo:400: 00000100:00100000:2.0:1787387963.925673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971826048:12345-0@lo:400: Request processed in 57us (11612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387963.925709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787387963.925738:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2712d80 x1874211971826048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387963.925748:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971826048:0@lo:400: 00000100:00080000:1.0:1787387963.926029:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787387964.425844:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971826304:0@lo:41: 00000100:00100000:2.0:1787387964.425914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.426029:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826304 00000100:00100000:1.0:1787387964.426038:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826304 00000100:00100000:1.0:1787387964.426086:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787387964.426094:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971826304:12345-0@lo:41: 00000004:00000024:1.0:1787387964.426126:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787387964.426185:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971826304:12345-0@lo:41: Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.426192:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787387964.426233:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971826304:0@lo:41: 00000020:01000004:2.0:1787387964.432525:0:9514:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387964.432530:0:9514:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787387964.432532:0:9514:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787387964.432715:0:9514:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff927401ba8000 00000020:01000004:2.0:1787387964.432730:0:9514:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787387964.432744:0:9514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787387964.432765:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9272c2cdb380) 00000020:00000080:2.0:1787387964.432782:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787387964.485381:0:9514:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787387964.485433:0:9514:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1787387964.531585:0:9514:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787387964.531913:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787387964.531928:0:9514:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787387964.531939:0:9514:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5cb77467b181192c 00000020:01000004:1.0:1787387964.531946:0:9514:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787387964.531970:0:9514:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787387964.531982:0:9514:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787387964.532069:0:9514:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787387964.532101:0:9514:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787387964.532105:0:9514:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787387964.549979:0:9514:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787387964.550095:0:9514:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.152@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787387964.550100:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787387964.550102:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787387964.550103:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387964.550104:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387964.550105:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387964.550106:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387964.550108:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387964.550109:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387964.550110:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387964.550112:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387964.550113:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387964.550117:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787387964.550259:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387964.550261:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787387964.550262:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387964.550263:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387964.550264:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387964.550265:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387964.550266:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387964.550267:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387964.550269:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387964.550270:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387964.550271:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387964.550299:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787387964.550318:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971826432:0@lo:253: 00000100:00100000:1.0:1787387964.550389:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.550507:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.551267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826432 00000100:00100000:2.0:1787387964.551276:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826432 00000100:00100000:2.0:1787387964.551336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787387964.551345:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:9514:x1874211971826432:12345-0@lo:253: 20000000:01000000:2.0:1787387964.551376:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787387964.551380:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787387964.551385:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787387964.551389:0:6514:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787387964.551663:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387964.553017:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1787387964.553038:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787387964.553058:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1787387964.553064:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787387964.553076:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1787387964.553089:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1787387964.553843:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1787387964.553865:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.152@tcp 20000000:01000000:2.0:1787387964.553867:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:2.0:1787387964.553880:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1787387964.553885:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387964.553898:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1787387964.553904:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:2.0:1787387964.553917:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1787387964.553924:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787387964.553934:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1787387964.553947:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1787387964.554484:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1787387964.554500:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.152@tcp 20000000:01000000:2.0:1787387964.554502:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:2.0:1787387964.554519:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1787387964.554525:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387964.554538:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1787387964.554543:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:2.0:1787387964.554556:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1787387964.554562:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787387964.554576:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1787387964.554592:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00010000:00010000:0.0:1787387964.556538:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387964.556867:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787387964.556893:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.152@tcp 20000000:01000000:2.0:1787387964.556896:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.152@tcp (null) (null) (null) 00000040:00080000:2.0:1787387964.556914:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787387964.556921:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787387964.556936:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787387964.556942:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.152@tcp (null) (null) 00000040:00080000:2.0:1787387964.556954:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787387964.556978:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787387964.557079:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787387964.557102:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787387964.557201:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787387964.557204:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787387964.557208:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787387964.557255:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787387964.557258:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387964.559600:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387964.559648:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387964.559666:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787387964.563711:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787387964.564301:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787387964.564333:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787387964.564350:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787387964.564353:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787387964.565394:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787387964.565428:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787387964.565449:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787387964.566122:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787387964.566319:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787387964.566336:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787387964.566352:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787387964.566355:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387964.567221:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387964.567256:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387964.567273:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787387964.567470:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787387964.567580:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787387964.567757:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787387964.567772:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787387964.567775:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787387964.568474:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1787387964.569772:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1787387964.569804:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1787387964.569821:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1787387964.569833:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787387964.569835:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787387964.571193:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787387964.571243:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787387964.571258:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787387964.571738:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787387964.571772:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787387964.571790:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:3.0:1787387964.571809:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787387964.571828:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571846:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811806 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571853:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811822 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571859:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811830 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571872:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181186f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571878:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181187d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571884:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571891:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18118bc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.571898:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.572401:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18118bc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.572417:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18118bc expref: 21 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.572431:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826560:0@lo:104: 00000100:00100000:3.0:1787387964.572500:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387964.574490:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.574509:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 21 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.574522:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826688:0@lo:104: 00000100:00100000:3.0:1787387964.574669:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387964.575302:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b181187d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.575313:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b181187d expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.575322:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826816:0@lo:104: 00000100:00100000:3.0:1787387964.575378:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.575422:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826560 00000100:00100000:0.0:1787387964.575431:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826560 00010000:00010000:3.0:1787387964.575499:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b181186f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.575508:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b181186f expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.575517:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826944:0@lo:104: 00000100:00100000:3.0:1787387964.575540:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387964.575568:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811830 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.575576:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811830 expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.575585:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971827072:0@lo:104: 00000100:00100000:3.0:1787387964.575617:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387964.575635:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811822 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.575643:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811822 expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.575663:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971827200:0@lo:104: 00000100:00100000:3.0:1787387964.576258:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387964.576289:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811806 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.576299:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811806 expref: 21 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.576307:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971827328:0@lo:104: 00000100:00100000:3.0:1787387964.576326:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.576400:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826688 00000100:00100000:2.0:1787387964.576406:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826688 00000100:00100000:2.0:1787387964.576456:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787387964.576474:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.576484:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826816 00000100:00100000:2.0:1787387964.576487:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826816 00000100:00100000:2.0:1787387964.576502:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971826944 00000100:00100000:2.0:1787387964.576505:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971826944 00000100:00100000:2.0:1787387964.576514:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827072 00000100:00100000:2.0:1787387964.576517:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827072 00000100:00100000:2.0:1787387964.576526:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827200 00000100:00100000:2.0:1787387964.576528:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827200 00000100:00100000:2.0:1787387964.576536:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827328 00000100:00100000:2.0:1787387964.576538:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827328 00000100:00100000:3.0:1787387964.576826:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387964.576834:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6514:x1874211971826688:12345-0@lo:104: 00010000:00010000:3.0:1787387964.576847:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.577100:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826688:0@lo:104: 00010000:00010000:3.0:1787387964.577142:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387964.577149:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:6514:x1874211971826688:12345-0@lo:104: Request processed in 315us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.577157:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387964.577175:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387964.577183:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+8:6514:x1874211971826816:12345-0@lo:104: 00010000:00010000:3.0:1787387964.577191:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.577267:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826816:0@lo:104: 00010000:00010000:0.0:1787387964.580052:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387964.580071:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580084:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.580089:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580099:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.580107:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.580113:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.580285:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580292:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.580317:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580324:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18118a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580340:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387964.580343:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580365:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1485200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.580368:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580375:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.580381:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.580386:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.580399:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580404:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.580410:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580415:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1485200/0x5cb77467b181187d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580425:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.580427:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.580429:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387964.580449:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971827456:0@lo:103: 00000100:00100000:0.0:1787387964.580514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.580559:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387964.580565:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971827584:0@lo:103: 00000100:00100000:0.0:1787387964.580596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.580629:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827456 00000100:00100000:0.0:1787387964.580635:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827456 00010000:00010000:0.0:1787387964.580660:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 22 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.580704:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827584 00000100:00100000:0.0:1787387964.580707:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827584 00010000:00010000:0.0:1787387964.580719:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181187d expref: 23 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.580739:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387964.580747:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3644:x1874211971827456:12345-0@lo:103: 00010000:00010000:0.0:1787387964.580759:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.580764:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 23 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580775:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 23 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580790:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1484000/0x5cb77467b18118ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18118a7 expref: 23 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580802:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.580833:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3644:x1874211971827456:12345-0@lo:103: Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.580841:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387964.580856:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387964.580863:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3644:x1874211971827584:12345-0@lo:103: 00010000:00010000:0.0:1787387964.580870:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.580881:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181187d expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580889:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b181187d expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580899:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a400/0x5cb77467b1811884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b181187d expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.580907:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.581248:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3644:x1874211971827584:12345-0@lo:103: Request processed in 384us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.581255:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387964.581303:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971827584:0@lo:103: 00000100:00100000:0.0:1787387964.581312:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971827456:0@lo:103: 00010000:00010000:3.0:1787387964.582626:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787387964.582639:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+8:6514:x1874211971826816:12345-0@lo:104: Request processed in 5454us (7258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.582661:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387964.582715:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387964.582725:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:6514:x1874211971826944:12345-0@lo:104: 00010000:00010000:3.0:1787387964.582739:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.582866:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826944:0@lo:104: 00010000:00010000:0.0:1787387964.584435:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387964.584450:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.584462:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.584467:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.584476:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.584483:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.584489:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.584562:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.584569:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.584600:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.584608:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b181186f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.584625:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.584627:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.584629:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387964.585609:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387964.585634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971827712:0@lo:103: 00000100:00100000:0.0:1787387964.585752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.585832:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827712 00000100:00100000:0.0:1787387964.585839:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827712 00010000:00010000:0.0:1787387964.585865:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181186f expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.585902:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387964.585909:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3647:x1874211971827712:12345-0@lo:103: 00010000:00010000:0.0:1787387964.585921:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.585926:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b181186f expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.585938:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b181186f expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.585955:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811876 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b181186f expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.585977:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.586009:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3647:x1874211971827712:12345-0@lo:103: Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.586017:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387964.586049:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971827712:0@lo:103: 00010000:00010000:3.0:1787387964.587104:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787387964.587117:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:6514:x1874211971826944:12345-0@lo:104: Request processed in 4392us (11574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.587127:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387964.587170:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387964.587181:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6514:x1874211971827072:12345-0@lo:104: 00010000:00010000:3.0:1787387964.587194:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.587309:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387964.587314:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:6514:x1874211971827072:12345-0@lo:104: Request processed in 138us (11697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.587320:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387964.587336:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387964.587343:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6514:x1874211971827200:12345-0@lo:104: 00010000:00010000:3.0:1787387964.587350:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.587380:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387964.587384:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:6514:x1874211971827200:12345-0@lo:104: Request processed in 43us (11130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.587400:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387964.587413:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387964.587419:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6514:x1874211971827328:12345-0@lo:104: 00010000:00010000:3.0:1787387964.587427:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.587454:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787387964.587459:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6514:x1874211971827328:12345-0@lo:104: Request processed in 41us (10986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.587465:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387964.587476:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387964.587483:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6514:x1874211971826560:12345-0@lo:104: 00010000:00010000:3.0:1787387964.587490:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.587516:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787387964.587521:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6514:x1874211971826560:12345-0@lo:104: Request processed in 40us (15022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.587527:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787387964.587612:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787387964.587619:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587627:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1482400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.587631:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587638:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.587645:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.587651:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.587707:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587713:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.587733:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587739:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1482400/0x5cb77467b1811830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811837 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587759:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787387964.587763:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587769:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.587772:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587779:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.587786:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.587791:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.587806:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587812:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.587824:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587831:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafb400/0x5cb77467b1811822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811829 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587839:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387964.587842:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587856:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.587858:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587864:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.587870:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.587874:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.587887:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587892:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.587897:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587903:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b4200/0x5cb77467b1811806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181180d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587911:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387964.587914:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587920:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152bc00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.587936:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587954:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.587960:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.587966:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.587978:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.587984:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.588000:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588006:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152bc00/0x5cb77467b18118bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588025:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.588026:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.588028:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.588035:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387964.588048:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971828224:0@lo:103: 00000100:00100000:0.0:1787387964.588086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.588112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387964.588118:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971827840:0@lo:103: 00000100:00100000:0.0:1787387964.588151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.588175:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971828096:0@lo:103: 00000100:00100000:0.0:1787387964.588196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.588221:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387964.588226:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971827968:0@lo:103: 00000100:00100000:0.0:1787387964.588247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.588274:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828224 00000100:00100000:0.0:1787387964.588281:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828224 00010000:00010000:0.0:1787387964.588302:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18118bc expref: 19 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.588318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827840 00000100:00100000:0.0:1787387964.588320:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827840 00010000:00010000:0.0:1787387964.588329:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811830 expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.588338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828096 00000100:00100000:0.0:1787387964.588340:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828096 00010000:00010000:0.0:1787387964.588349:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811806 expref: 21 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.588357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971827968 00000100:00100000:0.0:1787387964.588360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971827968 00010000:00010000:0.0:1787387964.588368:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811822 expref: 22 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.588380:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387964.588387:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3646:x1874211971828224:12345-0@lo:103: 00010000:00010000:0.0:1787387964.588397:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.588403:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18118bc expref: 22 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588414:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18118bc expref: 22 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588441:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.588470:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3646:x1874211971828224:12345-0@lo:103: Request processed in 83us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.588476:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387964.588511:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387964.588517:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971827840:12345-0@lo:103: 00010000:00010000:0.0:1787387964.588524:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.588528:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811830 expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588536:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811830 expref: 21 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588546:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.588566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971827840:12345-0@lo:103: Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.588571:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387964.588583:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387964.588590:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3645:x1874211971828096:12345-0@lo:103: 00010000:00010000:0.0:1787387964.588597:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.588601:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811806 expref: 20 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588609:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811806 expref: 20 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.588617:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.588649:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3645:x1874211971828096:12345-0@lo:103: Request processed in 59us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.588661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387964.589178:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387964.589187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3645:x1874211971827968:12345-0@lo:103: 00010000:00010000:0.0:1787387964.589195:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.589199:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811822 expref: 19 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589211:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811822 expref: 19 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589224:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589232:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589247:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589254:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589261:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589268:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589274:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152a200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787387964.589284:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589294:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589303:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.589312:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.589339:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3645:x1874211971827968:12345-0@lo:103: Request processed in 153us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.589345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387964.589397:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971827968:0@lo:103: 00000100:00100000:0.0:1787387964.589407:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971828096:0@lo:103: 00000100:00100000:0.0:1787387964.589435:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971827840:0@lo:103: 00000100:00100000:0.0:1787387964.589442:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971828224:0@lo:103: 00010000:00010000:0.0:1787387964.589458:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387964.590469:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b5000/0x5cb77467b1811837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811830 expref: 18 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.590487:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971827072:0@lo:104: 00010000:00010000:2.0:1787387964.590500:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811822 expref: 17 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.590524:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971827200:0@lo:104: 00010000:00010000:2.0:1787387964.590538:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152b800/0x5cb77467b181180d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811806 expref: 16 pid: 6515 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.590552:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971827328:0@lo:104: 00010000:00010000:2.0:1787387964.590564:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe400/0x5cb77467b18118c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18118bc expref: 15 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.590574:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecffb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874211971826560:0@lo:104: 00010000:00010000:2.0:1787387964.590609:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.590619:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.590625:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.590644:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a200/0x5cb77467b1811933 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387964.590873:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787387964.594763:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:9514:x1874211971826432:12345-0@lo:253: Request processed in 43409us (44364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.594777:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787387964.595255:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971826432:0@lo:253: 10000000:01000000:1.0:1787387964.595271:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787387964.595275:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387964.595277:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787387964.595317:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387964.595322:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787387964.595323:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387964.595325:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387964.595340:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387964.595344:0:9514:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787387964.595346:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387964.595347:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787387964.595480:0:9514:0:(tgt_mount.c:101:server_register_mount()) register mount ffff927401ba8000 from lustre-OST0001 10000000:01000000:1.0:1787387964.595770:0:9514:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787387964.595773:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787387964.595781:0:9514:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9273d0f44d40 local copy 10000000:01000000:1.0:1787387964.595786:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787387964.596074:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.596088:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.596117:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.596150:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828352:0@lo:101: 00000100:00100000:1.0:1787387964.596201:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.596249:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.597076:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828352 00000100:00100000:2.0:1787387964.597085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828352 00000100:00100000:3.0:1787387964.597206:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787387964.597217:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:9514:x1874211971828352:12345-0@lo:101: 00010000:00010000:3.0:1787387964.597231:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387964.597247:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152be00/0x5cb77467b1811941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181193a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.597270:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152be00/0x5cb77467b1811941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181193a expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.597292:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152be00/0x5cb77467b1811941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181193a expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.597302:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152be00, rc 0) 00000100:00100000:3.0:1787387964.597366:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828352:12345-0@lo:101: Request processed in 151us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.597372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787387964.597522:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828352:0@lo:101: 00010000:00010000:2.0:1787387964.597544:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.597565:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.597866:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828480:0@lo:501: 00000100:00100000:2.0:1787387964.597897:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.597918:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387964.598179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828480 00000100:00100000:1.0:1787387964.598184:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828480 00000100:00100000:1.0:1787387964.598260:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787387964.598268:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828480:12345-0@lo:501: 00000100:00100000:1.0:1787387964.598340:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828480:12345-0@lo:501: Request processed in 73us (442us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387964.598347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787387964.598405:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828480:0@lo:501: 10000000:01000000:2.0:1787387964.598418:0:9514:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787387964.598437:0:9514:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787387964.598442:0:9514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.598450:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.598457:0:9514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.598479:0:9514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787387964.598504:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff927401ba8000 10000000:01000000:2.0:1787387964.598509:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787387964.598515:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787387964.598517:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387964.598521:0:9514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787387964.598523:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787387964.598563:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.598571:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.598580:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.598593:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828608:0@lo:101: 00000100:00100000:2.0:1787387964.598629:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.598663:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387964.598669:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.598696:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387964.598700:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.598708:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.598726:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.598732:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387964.598752:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.598758:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.598775:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.598782:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b181193a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5cb77467b1811941 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.598793:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.598795:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.598797:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387964.598805:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387964.598815:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971828736:0@lo:103: 00000100:00100000:0.0:1787387964.598847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.598879:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828736 00000100:00100000:0.0:1787387964.598883:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828736 00000100:00100000:0.0:1787387964.598914:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387964.598921:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3646:x1874211971828736:12345-0@lo:103: 00010000:00010000:0.0:1787387964.598942:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.598955:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152be00/0x5cb77467b1811941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b181193a expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.598975:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.599022:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:3646:x1874211971828736:12345-0@lo:103: Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.599029:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387964.599058:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971828736:0@lo:103: 00000100:00100000:3.0:1787387964.605355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828608 00000100:00100000:3.0:1787387964.605369:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828608 00000100:00100000:0.0:1787387964.609166:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787387964.609193:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+14:9514:x1874211971828608:12345-0@lo:101: 00010000:00010000:0.0:1787387964.609212:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387964.609234:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811948 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.609265:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811948 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.609278:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811948 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.609287:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb400, rc 0) 00000100:00100000:0.0:1787387964.609354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828608:12345-0@lo:101: Request processed in 175us (10723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.609362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787387964.612113:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387964.612165:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828608:0@lo:101: 00010000:00010000:3.0:1787387964.612190:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.612204:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.612347:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828864:0@lo:501: 00000100:00100000:3.0:1787387964.612413:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.612439:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387964.613778:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828864 00000100:00100000:1.0:1787387964.613791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828864 00000100:00100000:1.0:1787387964.613851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787387964.613861:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828864:12345-0@lo:501: 00000100:00100000:1.0:1787387964.614188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828864:12345-0@lo:501: Request processed in 328us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.614196:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787387964.614338:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828864:0@lo:501: 00000100:00100000:2.0:1787387964.614386:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828992:0@lo:503: 00000100:00100000:2.0:1787387964.614440:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.614479:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387964.614495:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971828992 00000100:00100000:0.0:1787387964.614501:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971828992 00000100:00100000:0.0:1787387964.614529:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787387964.614536:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828992:12345-0@lo:503: 00000100:00100000:0.0:1787387964.614637:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971828992:12345-0@lo:503: Request processed in 101us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.614643:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787387964.614852:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971828992:0@lo:503: 00000040:00080000:2.0:1787387964.615093:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387964.615177:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829120:0@lo:502: 00000100:00100000:2.0:1787387964.615216:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.615245:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387964.615415:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829120 00000100:00100000:0.0:1787387964.615425:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829120 00000100:00100000:0.0:1787387964.615456:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787387964.615464:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971829120:12345-0@lo:502: 00000100:00100000:0.0:1787387964.615547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971829120:12345-0@lo:502: Request processed in 83us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.615554:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787387964.616369:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829120:0@lo:502: 00000040:00080000:2.0:1787387964.616605:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787387964.616634:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787387964.616649:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787387964.616662:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787387964.616707:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787387964.616729:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787387964.616758:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829248:0@lo:502: 00000100:00100000:2.0:1787387964.616810:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.616837:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387964.616849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829248 00000100:00100000:0.0:1787387964.616866:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829248 00000100:00100000:0.0:1787387964.616899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787387964.616906:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971829248:12345-0@lo:502: 00000100:00100000:0.0:1787387964.617014:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971829248:12345-0@lo:502: Request processed in 107us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.617022:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787387964.617085:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829248:0@lo:502: 00000040:00080000:2.0:1787387964.617124:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787387964.617147:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1787387964.618339:0:9525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387964.618350:0:9525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787387964.618362:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387964.618364:0:9525:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787387964.618372:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387964.618387:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9272c2cd8000) 00000020:00000080:2.0:1787387964.618412:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787387964.618420:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787387964.618488:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff927401ba8000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787387964.618496:0:9525:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787387964.618503:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5cb77467b181195d 00010000:00010000:3.0:1787387964.625374:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787387964.625908:0:9525:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787387964.629058:0:9525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787387964.629446:0:9525:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787387964.637513:0:9525:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787387964.638210:0:9525:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787387964.646082:0:9525:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787387964.648420:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787387964.648432:0:9525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387964.648438:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387964.648440:0:9525:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787387964.648443:0:9525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387964.648447:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387964.648448:0:9525:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387964.648451:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387964.648453:0:9525:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787387964.648473:0:9525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387964.648476:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387964.648477:0:9525:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387964.648480:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787387964.648836:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787387964.648866:0:9514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787387964.648883:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.648894:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387964.648903:0:9514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401ba8000 from 1 10000000:01000000:3.0:1787387964.648906:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387964.648957:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.648966:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.648977:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.649012:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829376:0@lo:101: 00000100:00100000:3.0:1787387964.649078:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.649123:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.649418:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829376 00000100:00100000:2.0:1787387964.649425:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829376 00000100:00100000:2.0:1787387964.649479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787387964.649498:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:9514:x1874211971829376:12345-0@lo:101: 00010000:00010000:2.0:1787387964.649513:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387964.649525:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811964 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.649958:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811964 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.649974:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811964 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.650138:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:2.0:1787387964.650212:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829376:12345-0@lo:101: Request processed in 716us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.650220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787387964.650309:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829376:0@lo:101: 00010000:00010000:3.0:1787387964.650326:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.650335:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.650458:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829504:0@lo:501: 00000100:00100000:3.0:1787387964.650495:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.650529:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.650769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829504 00000100:00100000:2.0:1787387964.650776:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829504 00000100:00100000:2.0:1787387964.650803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787387964.650810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829504:12345-0@lo:501: 00000100:00100000:2.0:1787387964.650917:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829504:12345-0@lo:501: Request processed in 106us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.651144:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829504:0@lo:501: 00000100:00100000:3.0:1787387964.651174:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829632:0@lo:503: 00000100:00100000:3.0:1787387964.651214:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.651245:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.651278:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787387964.651299:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829632 00000100:00100000:2.0:1787387964.651303:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829632 00000100:00100000:2.0:1787387964.651331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787387964.651338:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829632:12345-0@lo:503: 00000100:00100000:2.0:1787387964.651420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829632:12345-0@lo:503: Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.651436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787387964.651479:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829632:0@lo:503: 00000040:00080000:2.0:1787387964.652210:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387964.652285:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829760:0@lo:502: 00000100:00100000:2.0:1787387964.652336:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.652931:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387964.655833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829760 00000100:00100000:3.0:1787387964.655852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829760 00000100:00100000:3.0:1787387964.655959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787387964.655969:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829760:12345-0@lo:502: 00000100:00100000:3.0:1787387964.656167:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829760:12345-0@lo:502: Request processed in 199us (3829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.656175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787387964.656270:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829760:0@lo:502: 00000040:00080000:1.0:1787387964.656523:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787387964.656574:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787387964.656624:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829888:0@lo:502: 00000100:00100000:1.0:1787387964.656670:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.664116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971829888 00000100:00100000:2.0:1787387964.664142:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971829888 00000100:00100000:2.0:1787387964.664197:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787387964.664206:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829888:12345-0@lo:502: 00000100:00100000:2.0:1787387964.664394:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971829888:12345-0@lo:502: Request processed in 188us (7722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.664402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787387964.665095:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387964.665148:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971829888:0@lo:502: 00000040:00080000:1.0:1787387964.665238:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787387964.665253:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787387964.666088:0:9529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387964.666099:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387964.666101:0:9529:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787387964.666112:0:9529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff927401ba8000 00000020:00000080:2.0:1787387964.666115:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787387964.666138:0:9529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387964.666142:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387964.666143:0:9529:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787387964.666146:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787387964.666297:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787387964.666327:0:9514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787387964.666388:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.666400:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.666449:0:9514:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787387964.666452:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff927401ba8000 10000000:01000000:1.0:1787387964.666455:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff927401ba8000 10000000:01000000:1.0:1787387964.666459:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387964.666463:0:9514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff927401ba8000 from 1 10000000:01000000:1.0:1787387964.666466:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387964.666499:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.666507:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.666516:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.666537:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830016:0@lo:101: 00000100:00100000:1.0:1787387964.666815:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.666889:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.667152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830016 00000100:00100000:2.0:1787387964.667159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830016 00000100:00100000:2.0:1787387964.667235:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787387964.667244:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9514:x1874211971830016:12345-0@lo:101: 00010000:00010000:2.0:1787387964.667256:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387964.667283:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811972 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.667311:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811972 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.667322:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811972 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.667331:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe200, rc 0) 00000100:00100000:2.0:1787387964.667382:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830016:12345-0@lo:101: Request processed in 137us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.667389:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787387964.667459:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830016:0@lo:101: 00010000:00010000:1.0:1787387964.667480:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.667489:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.667585:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830144:0@lo:501: 00000100:00100000:1.0:1787387964.667622:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.667879:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387964.668105:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830144 00000100:00100000:0.0:1787387964.668111:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830144 00000100:00100000:0.0:1787387964.668147:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787387964.668154:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830144:12345-0@lo:501: 00000100:00100000:0.0:1787387964.668301:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830144:12345-0@lo:501: Request processed in 147us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.668308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787387964.668841:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830144:0@lo:501: 00000100:00100000:1.0:1787387964.668878:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830272:0@lo:503: 00000100:00100000:1.0:1787387964.669482:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.669570:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387964.669832:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830272 00000100:00100000:3.0:1787387964.669839:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830272 00000100:00100000:2.0:1787387964.670201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787387964.670211:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830272:12345-0@lo:503: 00000100:00100000:2.0:1787387964.670383:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830272:12345-0@lo:503: Request processed in 172us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.670390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787387964.670463:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830272:0@lo:503: 00000040:00080000:0.0:1787387964.671179:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387964.671252:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830400:0@lo:502: 00000100:00100000:0.0:1787387964.671302:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.671340:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387964.671391:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830400 00000100:00100000:1.0:1787387964.671396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830400 00000100:00100000:1.0:1787387964.671471:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787387964.671479:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830400:12345-0@lo:502: 00000100:00100000:1.0:1787387964.671589:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830400:12345-0@lo:502: Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.671606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787387964.671798:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830400:0@lo:502: 00000040:00080000:0.0:1787387964.672169:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787387964.672198:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787387964.672224:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787387964.672236:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787387964.672249:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787387964.672263:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787387964.672278:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787387964.672291:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787387964.672304:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787387964.672333:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787387964.672348:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787387964.672361:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787387964.672374:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787387964.672388:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787387964.672399:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787387964.672410:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787387964.672424:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787387964.672436:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787387964.672448:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787387964.672460:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787387964.672471:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787387964.672484:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787387964.672497:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787387964.672510:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787387964.672523:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787387964.672547:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787387964.672561:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787387964.672573:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787387964.672586:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787387964.673263:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787387964.673293:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787387964.673305:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787387964.673317:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787387964.673329:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787387964.673340:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787387964.673364:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787387964.673379:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787387964.673392:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787387964.673405:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787387964.673419:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787387964.673432:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787387964.673459:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787387964.673475:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787387964.673488:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787387964.673499:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787387964.673510:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787387964.674252:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830528:0@lo:502: 00000100:00100000:0.0:1787387964.674329:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.674374:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.674432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830528 00000100:00100000:2.0:1787387964.674440:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830528 00000100:00100000:2.0:1787387964.674492:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787387964.674501:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830528:12345-0@lo:502: 00000100:00100000:2.0:1787387964.674652:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971830528:12345-0@lo:502: Request processed in 151us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.674659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787387964.674871:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971830528:0@lo:502: 00000040:00080000:0.0:1787387964.674954:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787387964.674966:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787387964.676152:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787387964.676168:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9273ef9f4d40) 00000020:00000080:1.0:1787387964.676193:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787387964.676437:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff927401ba8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387964.676441:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927401ba8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387964.676444:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927401ba8000 3 00010000:00080000:1.0:1787387964.676489:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c2fb8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.152@tcp at head 00010000:00010000:1.0:1787387964.678733:0:9530:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1787387964.678837:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787387964.678880:0:9530:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787387964.679238:0:9530:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5cb77467b1811987 00000100:00080000:1.0:1787387964.679250:0:9530:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387964.679256:0:9530:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9272c2fb8000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787387964.679297:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2345f80 x1874211971830656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387964.679364:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971830656:0@lo:38: 00000100:00100000:2.0:1787387964.679443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.679538:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830656 00000100:00100000:3.0:1787387964.679547:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830656 00000100:00100000:3.0:1787387964.679585:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387964.679592:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874211971830656:12345-0@lo:38: 00010000:00080000:3.0:1787387964.679628:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1787387964.679660:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5cb77467b181198e 00000004:00100000:3.0:1787387964.679675:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787387964.679728:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9272c2425800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787387964.679873:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787387964.680152:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971830912:0@lo:400: 00000100:00100000:0.0:1787387964.680186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680209:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971831424:0@lo:400: 00000100:00100000:0.0:1787387964.680233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680253:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787387964.680258:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971830784:0@lo:400: 00000100:00100000:0.0:1787387964.680279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680290:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971831296:0@lo:400: 00000100:00100000:0.0:1787387964.680331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680361:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971831040:0@lo:400: 00000100:00100000:0.0:1787387964.680385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680405:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971831552:0@lo:400: 00000100:00100000:0.0:1787387964.680425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680438:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387964.680443:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971831168:0@lo:400: 00000100:00100000:0.0:1787387964.680464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.680492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830912 00000100:00100000:0.0:1787387964.680497:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830912 00000100:00100000:0.0:1787387964.680529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387964.680536:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971830912:12345-0@lo:400: 00000100:00100000:0.0:1787387964.680577:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971830912:12345-0@lo:400: Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.680583:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387964.680829:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787387964.680838:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787387964.680848:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831296 00000100:00100000:0.0:1787387964.680852:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831296 00000100:00100000:0.0:1787387964.680874:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831168 00000100:00100000:0.0:1787387964.680877:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831168 00000100:00100000:0.0:1787387964.680891:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387964.680896:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971831296:12345-0@lo:400: 00000100:00100000:0.0:1787387964.680942:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971831296:12345-0@lo:400: Request processed in 45us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.680948:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387964.680961:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387964.680967:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971831168:12345-0@lo:400: 00000100:00100000:0.0:1787387964.680999:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971831168:12345-0@lo:400: Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.681004:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787387964.681052:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd1c00 x1874211971831296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387964.681064:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971831296:0@lo:400: 00000100:00100000:0.0:1787387964.681074:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971830912:0@lo:400: 00010000:00080000:0.0:1787387964.681100:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd0000 x1874211971831168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387964.681108:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971831168:0@lo:400: 00000100:00100000:3.0:1787387964.684901:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874211971830656:12345-0@lo:38: Request processed in 5300us (5450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.684914:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787387964.685732:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2345f80 x1874211971830656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387964.685753:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387964.685765:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787387964.685773:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787387964.685778:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787387964.685781:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787387964.685789:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971830656:0@lo:38: 00000100:00100000:2.0:1787387964.685827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831424 00000100:00100000:2.0:1787387964.685834:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831424 00000100:00100000:2.0:1787387964.685866:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971830784 00000100:00100000:2.0:1787387964.685869:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971830784 00000100:00100000:2.0:1787387964.685880:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831040 00000100:00100000:2.0:1787387964.685882:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831040 00000100:00100000:2.0:1787387964.685892:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831552 00000100:00100000:2.0:1787387964.685894:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831552 00000100:00100000:2.0:1787387964.685908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387964.685915:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971831424:12345-0@lo:400: 00000100:00100000:2.0:1787387964.686007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971831424:12345-0@lo:400: Request processed in 91us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.686014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387964.686029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387964.686035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971830784:12345-0@lo:400: 00000100:00100000:2.0:1787387964.686064:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971830784:12345-0@lo:400: Request processed in 29us (5784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.686070:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387964.686081:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787387964.686087:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971831040:12345-0@lo:400: 00000100:00100000:2.0:1787387964.686147:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971831040:12345-0@lo:400: Request processed in 60us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.686154:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787387964.686165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387964.686171:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971831552:12345-0@lo:400: 00000100:00100000:2.0:1787387964.686215:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971831552:12345-0@lo:400: Request processed in 44us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.686222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787387964.686254:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eecbc000 x1874211971831040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387964.686266:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971831040:0@lo:400: 00010000:00080000:2.0:1787387964.686277:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273d0f5f480 x1874211971831552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387964.686285:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971831552:0@lo:400: 00010000:00080000:3.0:1787387964.686522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eecbca80 x1874211971830784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387964.686539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971830784:0@lo:400: 00010000:00080000:3.0:1787387964.686552:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273eedd0700 x1874211971831424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387964.686560:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971831424:0@lo:400: 00000020:01000004:1.0:1787387964.690319:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787387964.690338:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9273ef9f19c0) 00000020:00000080:1.0:1787387964.690364:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1787387964.690546:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff927401ba8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387964.690551:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927401ba8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387964.690554:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927401ba8000 3 00010000:00080000:1.0:1787387964.690586:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c2fbc800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.152@tcp at head 00000100:00100000:2.0:1787387964.695283:0:9532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1874211971831680:0@lo:901: 00000100:00100000:2.0:1787387964.695356:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.695400:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831680 00000100:00100000:2.0:1787387964.695407:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831680 00000100:00100000:2.0:1787387964.695462:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387964.695471:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1874211971831680:12345-0@lo:901: 00000100:00100000:2.0:1787387964.695563:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1874211971831680:12345-0@lo:901: Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.695571:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387964.696747:0:9532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6840 going to sleep for 11 seconds 00010000:00080000:3.0:1787387964.696807:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273f5cc7100 x1874211971831680/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787387980 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387964.696823:0:9532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1874211971831680:0@lo:901: 00000100:00080000:2.0:1787387964.697116:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787387964.697403:0:9530:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1787387964.697501:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787387964.697546:0:9530:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787387964.697558:0:9530:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5cb77467b181199c 00000100:00080000:1.0:1787387964.697567:0:9530:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387964.697573:0:9530:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9272c2fbc800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787387964.698020:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2345f80 x1874211971831808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387964.698074:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874211971831808:0@lo:38: 00000100:00100000:2.0:1787387964.698153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.698230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831808 00000100:00100000:3.0:1787387964.698236:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831808 00000100:00100000:3.0:1787387964.698273:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387964.698281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971831808:12345-0@lo:38: 00010000:00080000:3.0:1787387964.698307:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1787387964.698351:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5cb77467b18119a3 00000004:00100000:3.0:1787387964.698366:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787387964.698399:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9272c2422000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787387964.699198:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1787387964.700810:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1787387964.700862:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1787387964.700895:0:9514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387964.700912:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.701121:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787387964.701180:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787387964.701182:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787387964.701184:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387964.701185:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387964.701186:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387964.701188:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387964.701189:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387964.701191:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787387964.701192:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787387964.701194:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387964.701195:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387964.701198:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787387964.701201:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787387964.701202:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787387964.701203:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387964.701209:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387964.701211:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387964.701212:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387964.701212:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387964.701213:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787387964.701214:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787387964.701215:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387964.701216:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387964.701238:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787387964.701256:0:9514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971831936:0@lo:253: 00000100:00100000:0.0:1787387964.701337:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.701375:0:9514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387964.701546:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874211971831808:12345-0@lo:38: Request processed in 3263us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.701558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787387964.703402:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c2345f80 x1874211971831808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387964.703527:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387964.703537:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787387964.703546:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787387964.703551:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787387964.703556:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2fbc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787387964.703564:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874211971831808:0@lo:38: 00000100:00100000:2.0:1787387964.703612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971831936 00000100:00100000:2.0:1787387964.703619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971831936 00000100:00100000:2.0:1787387964.704121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787387964.704145:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971831936:12345-0@lo:253: 20000000:01000000:2.0:1787387964.704194:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787387964.704210:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787387964.713432:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787387964.713491:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787387964.713801:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9514:x1874211971831936:12345-0@lo:253: Request processed in 9655us (12460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.713813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787387964.713948:0:9514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9514:1874211971831936:0@lo:253: 10000000:01000000:1.0:1787387964.713962:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787387964.713978:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387964.713980:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787387964.713981:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387964.713982:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387964.713984:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387964.713985:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387964.713987:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387964.713988:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387964.713990:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387964.713991:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387964.713993:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787387964.714010:0:9514:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787387964.714241:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787387964.714246:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787387964.714269:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.714287:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811909 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.714301:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811917 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.714310:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.714348:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811917 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.714362:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811917 expref: 16 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.714604:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971832064:0@lo:104: 00000100:00100000:3.0:1787387964.714645:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387964.714759:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811909 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.714767:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811909 expref: 16 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.714775:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971832192:0@lo:104: 00000100:00100000:3.0:1787387964.714796:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.714865:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387964.714899:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832064 00000100:00100000:2.0:1787387964.714906:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832064 00000100:00100000:2.0:1787387964.714940:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832192 00000100:00100000:2.0:1787387964.714943:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832192 00000100:00100000:2.0:1787387964.714957:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387964.714965:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6536:x1874211971832064:12345-0@lo:104: 00010000:00010000:2.0:1787387964.715098:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715203:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387964.715209:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:6536:x1874211971832064:12345-0@lo:104: Request processed in 245us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.715226:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387964.715243:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787387964.715249:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971832192:12345-0@lo:104: 00010000:00010000:2.0:1787387964.715256:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715296:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387964.715303:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:6536:x1874211971832192:12345-0@lo:104: Request processed in 55us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.715308:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787387964.715325:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387964.715331:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715337:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5c00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387964.715341:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715349:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387964.715357:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387964.715362:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387964.715417:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715423:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387964.715517:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387964.715521:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715523:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715529:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5200 already unused, calling callback (ffffffffc1250c20) 00010000:00010000:2.0:1787387964.715530:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b1811917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181191e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387964.715533:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715539:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715541:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387964.715543:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387964.715545:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1787387964.715546:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387964.715551:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787387964.715563:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971832320:0@lo:103: 00010000:00010000:0.0:1787387964.715571:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715582:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787387964.715591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.715600:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715606:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811910 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715618:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.715620:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.715621:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387964.715624:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832320 00000100:00100000:0.0:1787387964.715626:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387964.715628:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832320 00000100:00100000:0.0:1787387964.715635:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971832448:0@lo:103: 00010000:00010000:2.0:1787387964.715643:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811917 expref: 17 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.715660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387964.715663:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387964.715670:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:3647:x1874211971832320:12345-0@lo:103: 00000100:00100000:0.0:1787387964.715700:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832448 00010000:00010000:2.0:1787387964.715704:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787387964.715704:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832448 00010000:00010000:2.0:1787387964.715709:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811917 expref: 18 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715717:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811909 expref: 18 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715719:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811917 expref: 18 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.715733:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.715735:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387964.715741:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:3645:x1874211971832448:12345-0@lo:103: 00010000:00010000:0.0:1787387964.715748:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387964.715752:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811909 expref: 18 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.715758:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:3647:x1874211971832320:12345-0@lo:103: Request processed in 88us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1787387964.715762:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811909 expref: 18 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.715764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787387964.715774:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715792:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387964.715797:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971832320:0@lo:103: 20000000:01000000:0.0:1787387964.715805:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014318645s 00010000:00010000:0.0:1787387964.715808:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715815:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715821:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715828:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715833:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152a600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787387964.715837:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715844:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715851:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.715860:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387964.715896:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:3645:x1874211971832448:12345-0@lo:103: Request processed in 155us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.715903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787387964.717218:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971832448:0@lo:103: 00010000:00010000:3.0:1787387964.718140:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b4400/0x5cb77467b181191e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811917 expref: 16 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.718159:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971832064:0@lo:104: 00010000:00010000:3.0:1787387964.718172:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811909 expref: 15 pid: 6513 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.718197:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211971832192:0@lo:104: 00010000:00010000:3.0:1787387964.718218:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.718228:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.718235:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.718241:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a600/0x5cb77467b18119aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787387964.721528:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787387964.722868:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787387964.724780:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787387964.724975:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787387964.725193:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787387964.725416:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787387964.728730:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787387964.747295:0:9514:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787387964.747305:0:9514:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787387964.747350:0:9514:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787387964.748151:0:9514:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787387964.748174:0:9514:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787387964.748195:0:9514:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787387964.749304:0:9514:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387964.752998:0:9514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787387965.575829:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787387965.661360:0:9587:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387965.662049:0:9587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787387965.959906:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971832576:0@lo:41: 00000100:00100000:2.0:1787387965.959988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.960155:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832576 00000100:00100000:3.0:1787387965.960163:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832576 00000100:00100000:3.0:1787387965.960226:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387965.960236:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971832576:12345-0@lo:41: 00000004:00000024:3.0:1787387965.960279:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787387965.960849:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971832576:12345-0@lo:41: Request processed in 559us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.960859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787387965.960937:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971832576:0@lo:41: 00010000:00010000:2.0:1787387966.600869:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387967.626105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387968.648997:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387969.031832:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387969.031859:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971832704:0@lo:13: 00000100:00100000:2.0:1787387969.031931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387969.032008:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832704 00000100:00100000:2.0:1787387969.032017:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832704 00000100:00100000:2.0:1787387969.032085:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387969.032095:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971832704:12345-0@lo:13: 00002000:00000024:2.0:1787387969.032125:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387969.032177:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971832704:12345-0@lo:13: Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.032184:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787387969.032203:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387969.032234:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4e00 x1874211971832704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387969.032251:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971832704:0@lo:13: 00000100:00100000:2.0:1787387969.033888:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971832832:0@lo:13: 00000100:00100000:2.0:1787387969.033949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387969.034015:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832832 00000100:00100000:2.0:1787387969.034023:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832832 00000100:00100000:2.0:1787387969.034085:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387969.034093:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971832832:12345-0@lo:13: 00002000:00000024:2.0:1787387969.034120:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387969.034540:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971832832:12345-0@lo:13: Request processed in 446us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.034548:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787387969.034568:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387969.034598:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4e00 x1874211971832832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387969.034615:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971832832:0@lo:13: 00000100:00100000:0.0:1787387969.543919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971832960:0@lo:41: 00000100:00100000:0.0:1787387969.543989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387969.544125:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971832960 00000100:00100000:1.0:1787387969.544134:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971832960 00000100:00100000:1.0:1787387969.544189:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787387969.544198:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971832960:12345-0@lo:41: 00000004:00000024:1.0:1787387969.544234:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787387969.544279:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971832960:12345-0@lo:41: Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.544301:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387969.544400:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971832960:0@lo:41: 00010000:00010000:0.0:1787387969.674044:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387970.058400:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971833472:0@lo:400: 00000100:00100000:1.0:1787387970.058486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.058540:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971833984:0@lo:400: 00000100:00100000:1.0:1787387970.058565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.058596:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787387970.058602:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971833088:0@lo:400: 00000100:00100000:1.0:1787387970.058629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.058649:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971833600:0@lo:400: 00000100:00100000:1.0:1787387970.058711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.058733:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971834112:0@lo:400: 00000100:00100000:1.0:1787387970.058755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387970.058953:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833472 00000100:00100000:3.0:1787387970.058961:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833472 00000100:00100000:3.0:1787387970.059010:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833984 00000100:00100000:3.0:1787387970.059014:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833984 00000100:00100000:3.0:1787387970.059049:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834112 00000100:00100000:3.0:1787387970.059052:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834112 00000100:00100000:3.0:1787387970.059072:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787387970.059081:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971833472:12345-0@lo:400: 00000100:00100000:1.0:1787387970.059158:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971833216:0@lo:400: 00000100:00100000:1.0:1787387970.059184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.059196:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971833728:0@lo:400: 00000100:00100000:1.0:1787387970.059213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.059230:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971834240:0@lo:400: 00000100:00100000:1.0:1787387970.059252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.059265:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787387970.059270:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971833344:0@lo:400: 00000100:00100000:1.0:1787387970.059290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.059307:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971833856:0@lo:400: 00000100:00100000:1.0:1787387970.059326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.059343:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971834368:0@lo:400: 00000100:00100000:1.0:1787387970.059374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.059399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833216 00000100:00100000:1.0:1787387970.059402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833216 00000100:00100000:1.0:1787387970.059419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834240 00000100:00100000:1.0:1787387970.059421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834240 00000100:00100000:1.0:1787387970.059435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834368 00000100:00100000:1.0:1787387970.059437:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834368 00000100:00100000:1.0:1787387970.059449:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387970.059456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971833984:12345-0@lo:400: 00000100:00100000:3.0:1787387970.061218:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971833472:12345-0@lo:400: Request processed in 2129us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.061232:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787387970.061269:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787387970.061284:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971834112:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061449:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971833984:12345-0@lo:400: Request processed in 1991us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061457:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387970.061472:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387970.061480:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971833216:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061513:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971833216:12345-0@lo:400: Request processed in 36us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061519:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387970.061532:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787387970.061538:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971834240:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061565:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971834240:12345-0@lo:400: Request processed in 27us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061570:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787387970.061583:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387970.061589:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971834368:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061616:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971834368:12345-0@lo:400: Request processed in 28us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387970.061651:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833600 00000100:00100000:1.0:1787387970.061670:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833600 00000100:00100000:1.0:1787387970.061717:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833344 00000100:00100000:1.0:1787387970.061720:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833344 00000100:00100000:1.0:1787387970.061731:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387970.061735:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971833600:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971833600:12345-0@lo:400: Request processed in 31us (3055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387970.061793:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787387970.061798:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971833344:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061821:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971833344:12345-0@lo:400: Request processed in 23us (2530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787387970.061847:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833728 00000100:00100000:1.0:1787387970.061850:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833728 00000100:00100000:1.0:1787387970.061868:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833856 00000100:00100000:1.0:1787387970.061870:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833856 00000100:00100000:1.0:1787387970.061880:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387970.061885:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971833728:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061911:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971833728:12345-0@lo:400: Request processed in 26us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061917:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387970.061925:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387970.061930:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971833856:12345-0@lo:400: 00000100:00100000:1.0:1787387970.061950:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971833856:12345-0@lo:400: Request processed in 20us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.061955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387970.062012:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971833344:0@lo:400: 00010000:00080000:1.0:1787387970.062035:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2713100 x1874211971833856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.062046:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971833856:0@lo:400: 00010000:00080000:1.0:1787387970.062057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364df80 x1874211971834368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.062065:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971834368:0@lo:400: 00010000:00080000:1.0:1787387970.062075:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2712d80 x1874211971833216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.062083:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971833216:0@lo:400: 00010000:00080000:1.0:1787387970.062093:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2713800 x1874211971833728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.062101:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971833728:0@lo:400: 00010000:00080000:1.0:1787387970.062111:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364c380 x1874211971834240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.062119:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971834240:0@lo:400: 00000100:00100000:3.0:1787387970.067575:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971834112:12345-0@lo:400: Request processed in 6289us (8809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.067590:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787387970.067631:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787387970.067636:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387970.067804:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971833088 00000100:00100000:0.0:1787387970.067814:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971833088 00000100:00100000:0.0:1787387970.067870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787387970.067879:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3644:x1874211971833088:12345-0@lo:400: 00000100:00100000:0.0:1787387970.067951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3644:x1874211971833088:12345-0@lo:400: Request processed in 74us (9321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.067958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:2.0:1787387970.074183:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364d180 x1874211971834112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387970.074204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971834112:0@lo:400: 00010000:00080000:3.0:1787387970.076523:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2713b80 x1874211971833472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387970.076547:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971833472:0@lo:400: 00010000:00080000:3.0:1787387970.076562:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2712680 x1874211971833984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387970.076571:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971833984:0@lo:400: 00000100:00100000:3.0:1787387970.076601:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971833088:0@lo:400: 00000100:00100000:3.0:1787387970.076613:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971833600:0@lo:400: 00000001:02000400:1.0:1787387970.353651:0:9877:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787387970.695972:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787387971.080716:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387971.080725:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eef18800 from 39 10000000:01000000:2.0:1787387971.080731:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387971.080768:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.080782:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.080794:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387971.080817:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971834624:0@lo:101: 00000100:00100000:2.0:1787387971.080890:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.080942:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.081146:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971834496:0@lo:41: 00000100:00100000:0.0:1787387971.081184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.081218:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834624 00000100:00100000:0.0:1787387971.081225:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834624 00000100:00100000:0.0:1787387971.081266:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787387971.081275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971834624:12345-0@lo:101: 00010000:00010000:0.0:1787387971.081289:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.081303:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18119b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.081327:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.081356:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.081366:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:0.0:1787387971.081407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971834624:12345-0@lo:101: Request processed in 133us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.081413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787387971.081475:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971834624:0@lo:101: 00010000:00010000:0.0:1787387971.081490:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.081498:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.081555:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971834752:0@lo:501: 00000100:00100000:0.0:1787387971.081580:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.081595:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.081663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834496 00000100:00100000:1.0:1787387971.081668:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834496 00000100:00100000:1.0:1787387971.081765:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787387971.081773:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971834496:12345-0@lo:41: 00000004:00000024:1.0:1787387971.081801:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1787387971.081849:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971834496:12345-0@lo:41: Request processed in 76us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.081855:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387971.082403:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971834496:0@lo:41: 00000100:00100000:3.0:1787387971.082501:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834752 00000100:00100000:3.0:1787387971.082506:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834752 00000100:00100000:3.0:1787387971.082586:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787387971.082594:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971834752:12345-0@lo:501: 00000100:00100000:3.0:1787387971.082759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971834752:12345-0@lo:501: Request processed in 165us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.082779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787387971.082842:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971834752:0@lo:501: 00000100:00100000:2.0:1787387971.082882:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971834880:0@lo:503: 00000100:00100000:2.0:1787387971.082921:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.084641:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.084906:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971834880 00000100:00100000:0.0:1787387971.084915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971834880 00000100:00100000:0.0:1787387971.084960:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787387971.084968:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971834880:12345-0@lo:503: 00000100:00100000:0.0:1787387971.085121:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971834880:12345-0@lo:503: Request processed in 151us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.085128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787387971.085237:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971834880:0@lo:503: 00000100:00100000:3.0:1787387971.085844:0:9910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9910:1874211971835008:0@lo:502: 00000100:00100000:3.0:1787387971.085895:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.086050:0:9910:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.086120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835008 00000100:00100000:1.0:1787387971.086127:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835008 00000100:00100000:1.0:1787387971.086347:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787387971.086355:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9910:x1874211971835008:12345-0@lo:502: 00000100:00100000:1.0:1787387971.086479:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9910:x1874211971835008:12345-0@lo:502: Request processed in 124us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.086487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787387971.087035:0:9910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9910:1874211971835008:0@lo:502: 00000100:00100000:2.0:1787387971.087093:0:9910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9910:1874211971835136:0@lo:502: 00000100:00100000:2.0:1787387971.087138:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.087173:0:9910:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.087338:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835136 00000100:00100000:1.0:1787387971.087344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835136 00000100:00100000:1.0:1787387971.087379:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787387971.087386:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9910:x1874211971835136:12345-0@lo:502: 00000100:00100000:1.0:1787387971.087478:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:9910:x1874211971835136:12345-0@lo:502: Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.087484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787387971.087676:0:9910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9910:1874211971835136:0@lo:502: 00000040:00080000:2.0:1787387971.087725:0:9910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787387971.088081:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787387971.088107:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387971.088118:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.088130:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387971.088139:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787387971.088142:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787387971.088145:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387971.088171:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.088188:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.088197:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.088211:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835264:0@lo:101: 00000100:00100000:1.0:1787387971.088246:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.088445:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.089440:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835264 00000100:00100000:0.0:1787387971.089465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835264 00000100:00100000:2.0:1787387971.089632:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787387971.089847:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971835264:12345-0@lo:101: 00010000:00010000:3.0:1787387971.089863:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387971.089881:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18119bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.089909:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18119bf expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.089921:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119bf expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.089931:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152a600, rc 0) 00000100:00100000:3.0:1787387971.090054:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971835264:12345-0@lo:101: Request processed in 414us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.090061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787387971.090235:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835264:0@lo:101: 00010000:00010000:1.0:1787387971.090253:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.090263:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.090329:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835392:0@lo:501: 00000100:00100000:1.0:1787387971.090360:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.090461:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.090538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835392 00000100:00100000:3.0:1787387971.090544:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835392 00000100:00100000:3.0:1787387971.090567:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787387971.090574:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971835392:12345-0@lo:501: 00000100:00100000:3.0:1787387971.090740:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971835392:12345-0@lo:501: Request processed in 165us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.090747:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787387971.090881:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835392:0@lo:501: 00000100:00100000:1.0:1787387971.090911:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835520:0@lo:503: 00000100:00100000:1.0:1787387971.090955:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.090982:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.091102:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835520 00000100:00100000:3.0:1787387971.091113:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835520 00000100:00100000:3.0:1787387971.091132:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787387971.091138:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971835520:12345-0@lo:503: 00000100:00100000:3.0:1787387971.091312:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971835520:12345-0@lo:503: Request processed in 173us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.091319:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787387971.091474:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835520:0@lo:503: 00000100:00100000:2.0:1787387971.093654:0:9911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9911:1874211971835648:0@lo:502: 00000100:00100000:2.0:1787387971.093780:0:9911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.093821:0:9911:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.093946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835648 00000100:00100000:3.0:1787387971.093954:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835648 00000100:00100000:3.0:1787387971.094016:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787387971.094026:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9911:x1874211971835648:12345-0@lo:502: 00000100:00100000:3.0:1787387971.094148:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9911:x1874211971835648:12345-0@lo:502: Request processed in 122us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.094156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787387971.094333:0:9911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9911:1874211971835648:0@lo:502: 00000020:01000000:2.0:1787387971.094363:0:9911:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387971.094371:0:9911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387971.094374:0:9911:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387971.094378:0:9911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387971.094380:0:9911:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787387971.094396:0:9911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9911:1874211971835776:0@lo:502: 00000100:00100000:2.0:1787387971.094425:0:9911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.094447:0:9911:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.094491:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835776 00000100:00100000:3.0:1787387971.094495:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835776 00000100:00100000:3.0:1787387971.094526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787387971.094533:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9911:x1874211971835776:12345-0@lo:502: 00000100:00100000:3.0:1787387971.094602:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:9911:x1874211971835776:12345-0@lo:502: Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.094609:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787387971.094837:0:9911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9911:1874211971835776:0@lo:502: 00000020:01000000:2.0:1787387971.094858:0:9911:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387971.094869:0:9911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387971.094870:0:9911:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387971.094875:0:9911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787387971.095041:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787387971.095069:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787387971.095080:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.095091:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387971.095100:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387971.095103:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eedc0000 from 39 10000000:01000000:1.0:1787387971.095107:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387971.095132:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.095140:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.095150:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.095164:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835904:0@lo:101: 00000100:00100000:1.0:1787387971.095192:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.095213:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.095313:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971835904 00000100:00100000:0.0:1787387971.095318:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971835904 00000100:00100000:0.0:1787387971.095354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787387971.095362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971835904:12345-0@lo:101: 00010000:00010000:0.0:1787387971.095371:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.095384:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18119cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.095406:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18119cd expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.095418:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119cd expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.095428:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa600, rc 0) 00000100:00100000:0.0:1787387971.095467:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971835904:12345-0@lo:101: Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.095473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787387971.095542:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971835904:0@lo:101: 00010000:00010000:1.0:1787387971.095555:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.095575:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.095622:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836032:0@lo:501: 00000100:00100000:1.0:1787387971.095652:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.095706:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.096081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836032 00000100:00100000:0.0:1787387971.096086:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836032 00000100:00100000:0.0:1787387971.096120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787387971.096127:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971836032:12345-0@lo:501: 00000100:00100000:0.0:1787387971.096245:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971836032:12345-0@lo:501: Request processed in 118us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.096252:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787387971.096316:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836032:0@lo:501: 00000100:00100000:2.0:1787387971.096345:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836160:0@lo:503: 00000100:00100000:2.0:1787387971.096381:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.096408:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.096460:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836160 00000100:00100000:3.0:1787387971.096465:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836160 00000100:00100000:3.0:1787387971.096485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787387971.096492:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971836160:12345-0@lo:503: 00000100:00100000:3.0:1787387971.096576:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971836160:12345-0@lo:503: Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.096583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787387971.096670:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836160:0@lo:503: 00000100:00100000:2.0:1787387971.097108:0:9912:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9912:1874211971836288:0@lo:502: 00000100:00100000:2.0:1787387971.097141:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.097166:0:9912:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.097205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836288 00000100:00100000:3.0:1787387971.097209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836288 00000100:00100000:3.0:1787387971.097238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787387971.097245:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:9912:x1874211971836288:12345-0@lo:502: 00000100:00100000:3.0:1787387971.097330:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:9912:x1874211971836288:12345-0@lo:502: Request processed in 85us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.097337:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787387971.097479:0:9912:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9912:1874211971836288:0@lo:502: 00000100:00100000:2.0:1787387971.097518:0:9912:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9912:1874211971836416:0@lo:502: 00000100:00100000:2.0:1787387971.097548:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.097568:0:9912:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.097612:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836416 00000100:00100000:3.0:1787387971.097615:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836416 00000100:00100000:3.0:1787387971.097642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787387971.097648:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:9912:x1874211971836416:12345-0@lo:502: 00000100:00100000:3.0:1787387971.097940:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:9912:x1874211971836416:12345-0@lo:502: Request processed in 291us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.097947:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787387971.098053:0:9912:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9912:1874211971836416:0@lo:502: 00000040:00080000:2.0:1787387971.098071:0:9912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787387971.098219:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787387971.098241:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387971.098249:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.098258:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387971.098267:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387971.098269:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273eedc0000 from 6 10000000:01000000:3.0:1787387971.098272:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387971.098295:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.098302:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.098319:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.098334:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836544:0@lo:101: 00000100:00100000:3.0:1787387971.098362:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.098391:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.098446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836544 00000100:00100000:1.0:1787387971.098451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836544 00000100:00100000:1.0:1787387971.098483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787387971.098490:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971836544:12345-0@lo:101: 00010000:00010000:1.0:1787387971.098499:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387971.098512:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b5000/0x5cb77467b18119e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18119db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.098535:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b5000/0x5cb77467b18119e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18119db expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.098546:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b5000/0x5cb77467b18119e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119db expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.098555:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b5000, rc 0) 00000100:00100000:1.0:1787387971.098593:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971836544:12345-0@lo:101: Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.098599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787387971.098706:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836544:0@lo:101: 00010000:00010000:3.0:1787387971.098719:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.098727:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.098766:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836672:0@lo:256: 00000100:00100000:3.0:1787387971.098791:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.098806:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.098922:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836672 00000100:00100000:0.0:1787387971.098927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836672 00000100:00100000:0.0:1787387971.098957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787387971.098963:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971836672:12345-0@lo:256: 20000000:01000000:0.0:1787387971.098980:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787387971.098995:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787387971.098997:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787387971.099083:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971836672:12345-0@lo:256: Request processed in 120us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.099090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787387971.099195:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836672:0@lo:256: 10000000:01000000:3.0:1787387971.099237:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787387971.099243:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.099252:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387971.099259:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787387971.099262:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1787387971.099269:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787387971.099285:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.099314:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.099322:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.099334:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836800:0@lo:101: 00000100:00100000:3.0:1787387971.099358:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.099387:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.099432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836800 00000100:00100000:2.0:1787387971.099437:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836800 00000100:00100000:2.0:1787387971.099469:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787387971.099476:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971836800:12345-0@lo:101: 00010000:00010000:2.0:1787387971.099484:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387971.099494:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b18119e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.099509:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.099526:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.099534:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe800, rc 0) 00000100:00100000:2.0:1787387971.099898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971836800:12345-0@lo:101: Request processed in 422us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.099904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787387971.100212:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836800:0@lo:101: 00010000:00010000:3.0:1787387971.100228:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.100238:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.100295:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836928:0@lo:501: 00000100:00100000:3.0:1787387971.100324:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.100353:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.100400:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971836928 00000100:00100000:2.0:1787387971.100404:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971836928 00000100:00100000:2.0:1787387971.100438:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787387971.100445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971836928:12345-0@lo:501: 00000100:00100000:2.0:1787387971.100654:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971836928:12345-0@lo:501: Request processed in 208us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.100670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787387971.101097:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971836928:0@lo:501: 00000100:00100000:3.0:1787387971.101130:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971837056:0@lo:503: 00000100:00100000:3.0:1787387971.101174:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.101235:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.101271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837056 00000100:00100000:2.0:1787387971.101275:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837056 00000100:00100000:2.0:1787387971.101340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787387971.101349:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971837056:12345-0@lo:503: 00000100:00100000:2.0:1787387971.101429:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971837056:12345-0@lo:503: Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.101437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787387971.101506:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971837056:0@lo:503: 00000100:00100000:3.0:1787387971.102016:0:9913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9913:1874211971837184:0@lo:502: 00000100:00100000:3.0:1787387971.102054:0:9913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.102492:0:9913:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee57540 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.102572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837184 00000100:00100000:1.0:1787387971.102578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837184 00000100:00100000:1.0:1787387971.102612:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787387971.102619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:9913:x1874211971837184:12345-0@lo:502: 00000100:00100000:1.0:1787387971.102753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:9913:x1874211971837184:12345-0@lo:502: Request processed in 133us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.102759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787387971.102883:0:9913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9913:1874211971837184:0@lo:502: 00000020:01000000:3.0:1787387971.102907:0:9913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787387971.102916:0:9913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787387971.102923:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387971.102925:0:9913:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787387971.102932:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787387971.102936:0:9913:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:3.0:1787387971.102959:0:9913:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787387971.102962:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787387971.102978:0:9913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9272c24199c0) 00000020:00000080:3.0:1787387971.103014:0:9913:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787387971.103020:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787387971.103116:0:9913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787387971.103122:0:9913:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787387971.103139:0:9913:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b18119fe 00010000:00080000:3.0:1787387971.103171:0:9913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273fbf27000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787387971.103393:0:9913:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1787387971.103575:0:9913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787387971.103587:0:9913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787387971.103791:0:9913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387971.103903:0:9913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387971.104043:0:9913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787387971.104125:0:9913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787387971.105061:0:9914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387971.105067:0:9914:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787387971.105643:0:9913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787387971.105654:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787387971.106059:0:9913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787387971.106086:0:9913:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1811a05 00000100:00080000:2.0:1787387971.106104:0:9913:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387971.106110:0:9913:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9273fbf27000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787387971.106145:0:9913:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273f5cc5f80 x1874211971837312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387971.106163:0:9913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787387971.106326:0:9913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387971.106331:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387971.106334:0:9913:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787387971.106337:0:9913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387971.106341:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387971.106343:0:9913:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387971.106345:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387971.106347:0:9913:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787387971.106372:0:9913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9913:1874211971838592:0@lo:502: 00000100:00100000:2.0:1787387971.106458:0:9913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.106493:0:9913:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.106569:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971837312:0@lo:8: 00000100:00100000:1.0:1787387971.106611:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.106651:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971837568:0@lo:400: 00000100:00100000:1.0:1787387971.106814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.106833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971838080:0@lo:400: 00000100:00100000:1.0:1787387971.106853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.106872:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787387971.106877:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971837696:0@lo:400: 00000100:00100000:1.0:1787387971.106900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.106916:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971838208:0@lo:400: 00000100:00100000:1.0:1787387971.106936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.106969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838592 00000100:00100000:1.0:1787387971.106977:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838592 00000100:00100000:1.0:1787387971.107032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787387971.107042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:9913:x1874211971838592:12345-0@lo:502: 00000100:00100000:1.0:1787387971.107169:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:9913:x1874211971838592:12345-0@lo:502: Request processed in 127us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.107177:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787387971.107225:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837568 00000100:00100000:1.0:1787387971.107229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837568 00000100:00100000:1.0:1787387971.107254:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838080 00000100:00100000:1.0:1787387971.107258:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838080 00000100:00100000:1.0:1787387971.107269:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838208 00000100:00100000:1.0:1787387971.107271:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838208 00000100:00100000:1.0:1787387971.107283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787387971.107289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971837568:12345-0@lo:400: 00000100:00100000:1.0:1787387971.107325:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971837568:12345-0@lo:400: Request processed in 36us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.107341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787387971.107354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787387971.107360:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971838080:12345-0@lo:400: 00000100:00100000:1.0:1787387971.107389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971838080:12345-0@lo:400: Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.107394:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787387971.107405:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387971.107410:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971838208:12345-0@lo:400: 00000100:00100000:1.0:1787387971.107434:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971838208:12345-0@lo:400: Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.107440:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387971.107460:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837696 00000100:00100000:1.0:1787387971.107463:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837696 00000100:00100000:1.0:1787387971.107485:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787387971.107490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971837696:12345-0@lo:400: 00000100:00100000:1.0:1787387971.107521:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971837696:12345-0@lo:400: Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.107527:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387971.107654:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837312 00000100:00100000:2.0:1787387971.107659:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837312 00000100:00100000:2.0:1787387971.107718:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387971.107723:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971837312:12345-0@lo:8: 00010000:00080000:2.0:1787387971.107747:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:2.0:1787387971.107775:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1811a0c 00002000:00100000:2.0:1787387971.107789:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9272c2f61000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787387971.107793:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787387971.107797:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787387971.107856:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787387971.108089:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787387971.108111:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9272c2f66800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387971.108163:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874211971837312:12345-0@lo:8: Request processed in 438us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.108170:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387971.108224:0:9913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9913:1874211971838592:0@lo:502: 00000020:01000000:2.0:1787387971.108259:0:9913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387971.108265:0:9913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387971.108268:0:9913:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387971.108272:0:9913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1787387971.108552:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971837824:0@lo:400: 00000100:00100000:0.0:1787387971.108645:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.108745:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971838336:0@lo:400: 00000100:00100000:0.0:1787387971.108769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.108789:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787387971.108795:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971837440:0@lo:400: 00000100:00100000:0.0:1787387971.108814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.108830:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971837952:0@lo:400: 00000100:00100000:0.0:1787387971.108850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.108867:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971838464:0@lo:400: 00000100:00100000:0.0:1787387971.108888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.108907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838336 00000100:00100000:0.0:1787387971.108913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838336 00000100:00100000:0.0:1787387971.108936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837440 00000100:00100000:0.0:1787387971.108939:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837440 00000100:00100000:0.0:1787387971.108949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838464 00000100:00100000:0.0:1787387971.108951:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838464 00000100:00100000:0.0:1787387971.108963:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787387971.108969:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971838336:12345-0@lo:400: 00000100:00100000:0.0:1787387971.109021:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971838336:12345-0@lo:400: Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.109038:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787387971.109051:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387971.109057:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971837440:12345-0@lo:400: 00000100:00100000:0.0:1787387971.109087:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971837440:12345-0@lo:400: Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.109093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387971.109103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387971.109108:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971838464:12345-0@lo:400: 00000100:00100000:0.0:1787387971.109131:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971838464:12345-0@lo:400: Request processed in 24us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.109136:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787387971.109164:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4000 x1874211971837440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.109178:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971837440:0@lo:400: 00010000:00080000:0.0:1787387971.109188:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4000 x1874211971838464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.109195:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971838464:0@lo:400: 00010000:00080000:0.0:1787387971.109204:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5f80 x1874211971838336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.109212:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971838336:0@lo:400: 00000100:00100000:0.0:1787387971.109237:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837824 00000100:00100000:0.0:1787387971.109241:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837824 00000100:00100000:0.0:1787387971.109273:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971837952 00000100:00100000:0.0:1787387971.109276:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971837952 00000100:00100000:0.0:1787387971.109300:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387971.109306:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971837824:12345-0@lo:400: 00000100:00100000:0.0:1787387971.109340:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971837824:12345-0@lo:400: Request processed in 34us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.109347:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387971.109358:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387971.109365:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971837952:12345-0@lo:400: 00000100:00100000:0.0:1787387971.109390:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971837952:12345-0@lo:400: Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.109396:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787387971.109418:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7b80 x1874211971837952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.109428:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971837952:0@lo:400: 00010000:00080000:0.0:1787387971.109439:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7100 x1874211971837824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.109447:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971837824:0@lo:400: 00000020:01000000:0.0:1787387971.109464:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1787387971.109495:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787387971.109506:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.109516:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387971.109528:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787387971.109530:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273c9714000 from 39 10000000:01000000:0.0:1787387971.109533:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:1.0:1787387971.109849:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971837696:0@lo:400: 00010000:00080000:1.0:1787387971.109872:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273d0f5f480 x1874211971838208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.109881:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971838208:0@lo:400: 00010000:00080000:1.0:1787387971.109894:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc5880 x1874211971837568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.109901:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971837568:0@lo:400: 00010000:00080000:1.0:1787387971.109924:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc6680 x1874211971838080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.109932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971838080:0@lo:400: 00010000:00080000:1.0:1787387971.109980:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc5f80 x1874211971837312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.109989:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387971.109997:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787387971.110017:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787387971.110022:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787387971.110026:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273fbf27000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787387971.110036:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787387971.110043:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971837312:0@lo:8: 00000100:00100000:1.0:1787387971.110087:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971838848:0@lo:700: 00000100:00100000:1.0:1787387971.110122:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.110142:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c180 going to sleep for 11 seconds 00000004:00080000:2.0:1787387971.110248:0:9914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787387971.110320:0:9914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 260094640156ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787387971.110328:0:9914:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1787387971.110844:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787387971.111270:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.111283:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.111294:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.111312:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971838720:0@lo:101: 00000100:00100000:0.0:1787387971.111356:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.111432:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.111452:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838848 00000100:00100000:0.0:1787387971.111457:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838848 00000100:00100000:0.0:1787387971.111520:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387971.111529:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9915:x1874211971838848:12345-0@lo:700: 00000100:00100000:0.0:1787387971.112348:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874211971838976:0@lo:700: 00000100:00100000:0.0:1787387971.112388:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.112411:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.112428:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838976 00000100:00100000:0.0:1787387971.112433:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838976 00000100:00100000:0.0:1787387971.112463:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387971.112472:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874211971838976:12345-0@lo:700: 00000100:00100000:1.0:1787387971.114817:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971838720 00000100:00100000:1.0:1787387971.114832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971838720 00000100:00100000:1.0:1787387971.114877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787387971.114886:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971838720:12345-0@lo:101: 00010000:00010000:1.0:1787387971.114900:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387971.114919:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811a13 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.114946:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787387971.114949:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787387971.114957:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.114981:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4200, rc 0) 00000100:00100000:1.0:1787387971.115081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971838720:12345-0@lo:101: Request processed in 195us (3724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.115088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787387971.116378:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971838720:0@lo:101: 00010000:00010000:0.0:1787387971.116403:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.116416:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.116576:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839104:0@lo:501: 00000100:00100000:0.0:1787387971.116717:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.116821:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.116872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839104 00000100:00100000:1.0:1787387971.116879:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839104 00000100:00100000:1.0:1787387971.116964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787387971.116972:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971839104:12345-0@lo:501: 00000100:00100000:1.0:1787387971.117115:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971839104:12345-0@lo:501: Request processed in 143us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.117122:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787387971.117243:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839104:0@lo:501: 00000100:00100000:0.0:1787387971.117274:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839232:0@lo:503: 00000100:00100000:0.0:1787387971.117313:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.117328:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.117342:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839232 00000100:00100000:0.0:1787387971.117346:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839232 00000100:00100000:0.0:1787387971.118121:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787387971.118134:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971839232:12345-0@lo:503: 00000100:00100000:0.0:1787387971.118257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971839232:12345-0@lo:503: Request processed in 126us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.118265:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787387971.118321:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839232:0@lo:503: 00000100:00100000:0.0:1787387971.118835:0:9917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9917:1874211971839360:0@lo:502: 00000100:00100000:0.0:1787387971.118884:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.118913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839360 00000100:00100000:0.0:1787387971.118918:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839360 00000100:00100000:0.0:1787387971.118945:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787387971.118951:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:9917:x1874211971839360:12345-0@lo:502: 00000100:00100000:0.0:1787387971.119037:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:9917:x1874211971839360:12345-0@lo:502: Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.119044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787387971.119079:0:9917:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.119090:0:9917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9917:1874211971839360:0@lo:502: 00000100:00100000:0.0:1787387971.119122:0:9917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9917:1874211971839488:0@lo:502: 00000100:00100000:0.0:1787387971.119336:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.119353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839488 00000100:00100000:0.0:1787387971.119357:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839488 00000100:00100000:0.0:1787387971.119377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787387971.119383:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:9917:x1874211971839488:12345-0@lo:502: 00000100:00100000:0.0:1787387971.119440:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:9917:x1874211971839488:12345-0@lo:502: Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.119447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787387971.119475:0:9917:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c7d59780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.119487:0:9917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9917:1874211971839488:0@lo:502: 00000040:00080000:0.0:1787387971.119755:0:9917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787387971.119947:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787387971.119967:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387971.119978:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.119989:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387971.119998:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787387971.120011:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c9714000 from 6 10000000:01000000:1.0:1787387971.120014:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787387971.120039:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.120047:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.120067:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.120080:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839616:0@lo:101: 00000100:00100000:1.0:1787387971.120112:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.120392:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.120434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839616 00000100:00100000:0.0:1787387971.120438:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839616 00000100:00100000:0.0:1787387971.120518:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787387971.120527:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971839616:12345-0@lo:101: 00010000:00010000:0.0:1787387971.120536:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.120549:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811a21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.120569:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811a21 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.120641:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a21 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.120660:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb800, rc 0) 00000100:00100000:0.0:1787387971.120717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971839616:12345-0@lo:101: Request processed in 190us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.120722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787387971.121067:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839616:0@lo:101: 00010000:00010000:0.0:1787387971.121082:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.121091:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.121308:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839744:0@lo:256: 00000100:00100000:0.0:1787387971.121447:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787387971.121713:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787387971.121786:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c7d599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.121803:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839744 00000100:00100000:0.0:1787387971.121808:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839744 00000100:00100000:0.0:1787387971.121842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787387971.121850:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971839744:12345-0@lo:256: 20000000:01000000:0.0:1787387971.121865:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787387971.121882:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787387971.121886:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787387971.121979:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971839744:12345-0@lo:256: Request processed in 129us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.121986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787387971.122027:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839744:0@lo:256: 10000000:01000000:0.0:1787387971.122072:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787387971.122085:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.122093:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387971.122102:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787387971.122105:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787387971.122107:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787387971.122128:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.122286:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.122299:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.122313:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839872:0@lo:101: 00000100:00100000:0.0:1787387971.122339:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.122409:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.122427:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971839872 00000100:00100000:0.0:1787387971.122431:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971839872 00000100:00100000:1.0:1787387971.122481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787387971.122490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971839872:12345-0@lo:101: 00010000:00010000:1.0:1787387971.122499:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387971.122519:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811a2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.122538:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.122546:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.122554:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4400, rc 0) 00000100:00100000:1.0:1787387971.122589:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971839872:12345-0@lo:101: Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.122604:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787387971.122897:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971839872:0@lo:101: 00010000:00010000:0.0:1787387971.122911:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.122919:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.122982:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840000:0@lo:501: 00000100:00100000:0.0:1787387971.123017:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.123074:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.123101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840000 00000100:00100000:1.0:1787387971.123105:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840000 00000100:00100000:1.0:1787387971.123125:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787387971.123130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971840000:12345-0@lo:501: 00000100:00100000:1.0:1787387971.123713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971840000:12345-0@lo:501: Request processed in 580us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.123721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787387971.123803:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840000:0@lo:501: 00000100:00100000:0.0:1787387971.123832:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840128:0@lo:503: 00000100:00100000:0.0:1787387971.123871:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.123898:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.123907:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840128 00000100:00100000:2.0:1787387971.123912:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840128 00000100:00100000:2.0:1787387971.123942:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787387971.123949:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971840128:12345-0@lo:503: 40000000:02000000:1.0:1787387971.123949:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787387971.124036:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971840128:12345-0@lo:503: Request processed in 87us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.124043:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787387971.124286:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840128:0@lo:503: 00000100:00100000:0.0:1787387971.126931:0:9918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9918:1874211971840256:0@lo:502: 00000100:00100000:0.0:1787387971.127029:0:9918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.127102:0:9918:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.128406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840256 00000100:00100000:2.0:1787387971.128434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840256 00000100:00100000:2.0:1787387971.128538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787387971.128549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:9918:x1874211971840256:12345-0@lo:502: 00000100:00100000:2.0:1787387971.128834:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:9918:x1874211971840256:12345-0@lo:502: Request processed in 285us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.128858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787387971.129217:0:9918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9918:1874211971840256:0@lo:502: 00000020:01000000:0.0:1787387971.129252:0:9918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787387971.129260:0:9918:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787387971.129266:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387971.129269:0:9918:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787387971.129274:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787387971.129277:0:9918:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:0.0:1787387971.129296:0:9918:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787387971.129298:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387971.129325:0:9918:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9273ff944d40) 00000020:00000080:0.0:1787387971.129351:0:9918:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1787387971.129358:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787387971.129446:0:9918:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787387971.129451:0:9918:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787387971.129462:0:9918:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1811a44 00010000:00080000:0.0:1787387971.129491:0:9918:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273fbf3b800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:0.0:1787387971.132081:0:9918:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1787387971.132602:0:9918:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787387971.132621:0:9918:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787387971.136110:0:9918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387971.136137:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874211971838976:12345-0@lo:700: Request processed in 23663us (23744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.136150:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787387971.136621:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bce00 x1874211971838976/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387971.136637:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874211971838976:0@lo:700: 40000000:02000000:2.0:1787387971.136659:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1787387971.138915:0:9918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387971.139076:0:9918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787387971.139186:0:9918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787387971.143121:0:9920:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787387971.143128:0:9920:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787387971.145151:0:9918:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787387971.145167:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787387971.145214:0:9918:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787387971.145245:0:9918:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1811a4b 00000100:00080000:1.0:1787387971.145257:0:9918:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387971.145264:0:9918:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9273fbf3b800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787387971.145305:0:9918:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c364d180 x1874211971840384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787387971.145337:0:9918:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787387971.145397:0:9918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387971.145402:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387971.145404:0:9918:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787387971.145407:0:9918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387971.145411:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387971.145413:0:9918:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387971.145416:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387971.145418:0:9918:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787387971.145449:0:9918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9918:1874211971840512:0@lo:502: 00000100:00100000:1.0:1787387971.145542:0:9918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.145582:0:9918:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.146270:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971840384:0@lo:8: 00000100:00100000:0.0:1787387971.146314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.146389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840512 00000100:00100000:0.0:1787387971.146396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840512 00000100:00100000:0.0:1787387971.146443:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787387971.146451:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:9918:x1874211971840512:12345-0@lo:502: 00000100:00100000:1.0:1787387971.146522:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840384 00000100:00100000:1.0:1787387971.146527:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840384 00000100:00100000:1.0:1787387971.146550:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387971.146555:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971840384:12345-0@lo:8: 00010000:00080000:1.0:1787387971.146579:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:1.0:1787387971.146607:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1811a52 00002000:00100000:1.0:1787387971.146620:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9273fbf3c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787387971.146624:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787387971.146627:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787387971.146726:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787387971.146750:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9273fbf39800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387971.146800:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874211971840384:12345-0@lo:8: Request processed in 242us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.146807:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387971.147032:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:9918:x1874211971840512:12345-0@lo:502: Request processed in 581us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.147039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:0.0:1787387971.147087:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364d180 x1874211971840384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.147097:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387971.147104:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787387971.147111:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787387971.147117:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787387971.147119:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273fbf3b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787387971.147127:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787387971.147132:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971840384:0@lo:8: 00000004:00080000:1.0:1787387971.147226:0:9920:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787387971.147270:0:9920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 260131590496ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787387971.147276:0:9920:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787387971.147302:0:9918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:9918:1874211971840512:0@lo:502: 00000020:01000000:1.0:1787387971.147324:0:9918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387971.147330:0:9918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387971.147332:0:9918:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787387971.147338:0:9918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1787387971.147777:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1787387971.147805:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787387971.147815:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.147828:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387971.147838:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787387971.147841:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9273d0f44d40 from 1 10000000:01000000:0.0:1787387971.147843:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787387971.147869:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.147877:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.147886:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.147901:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840640:0@lo:101: 00000100:00100000:0.0:1787387971.147932:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.147957:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.148522:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840640 00000100:00100000:1.0:1787387971.148530:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840640 00000100:00100000:1.0:1787387971.148570:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787387971.148578:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971840640:12345-0@lo:101: 00010000:00010000:1.0:1787387971.148588:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387971.148606:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811a59 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.148628:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.148639:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.148648:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4000, rc 0) 00000100:00100000:1.0:1787387971.148827:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971840640:12345-0@lo:101: Request processed in 248us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.148833:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787387971.148904:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840640:0@lo:101: 00010000:00010000:0.0:1787387971.148918:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.148926:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.148997:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840768:0@lo:501: 00000100:00100000:0.0:1787387971.149043:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.149066:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.149845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840768 00000100:00100000:1.0:1787387971.149853:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840768 00000100:00100000:1.0:1787387971.149898:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787387971.149907:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971840768:12345-0@lo:501: 00000100:00100000:1.0:1787387971.150012:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971840768:12345-0@lo:501: Request processed in 95us (957us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387971.150019:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787387971.150103:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971840768:0@lo:501: 10000000:01000000:0.0:1787387971.150136:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787387971.150145:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.150154:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787387971.156738:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787387971.156750:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787387971.156912:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9915:x1874211971838848:12345-0@lo:700: Request processed in 45378us (46783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.156927:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787387971.157022:0:9915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364df80 x1874211971838848/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.157037:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971838848:0@lo:700: 00000004:00080000:2.0:1787387971.161035:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787387971.161886:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387971.161912:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971840896:0@lo:13: 00000100:00100000:1.0:1787387971.161992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787387971.162052:0:9921:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787387971.162077:0:9921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971841024:0@lo:7: 00000100:00100000:1.0:1787387971.162103:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.162117:0:9921:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.162240:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971840896 00000100:00100000:2.0:1787387971.162249:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971840896 00000100:00100000:2.0:1787387971.162329:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387971.162340:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971840896:12345-0@lo:13: 00002000:00000024:2.0:1787387971.162369:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787387971.162419:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971840896:12345-0@lo:13: Request processed in 81us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.162426:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387971.162457:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841024 00000100:00100000:2.0:1787387971.162461:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841024 00000100:00100000:2.0:1787387971.162500:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387971.162508:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9921:x1874211971841024:12345-0@lo:7: 00000100:00080000:0.0:1787387971.165358:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387971.166108:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273d0f5f480 x1874211971840896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.166135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971840896:0@lo:13: 00002000:00080000:2.0:1787387971.169056:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787387971.169068:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787387971.169157:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9921:x1874211971841024:12345-0@lo:7: Request processed in 6646us (7049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.169167:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787387971.169364:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2712680 x1874211971841024/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.169378:0:9921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971841024:0@lo:7: 00000004:00080000:0.0:1787387971.169392:0:9921:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787387971.169430:0:9921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971841152:0@lo:5: 00000100:00100000:0.0:1787387971.169460:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.169496:0:9921:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.169749:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841152 00000100:00100000:0.0:1787387971.169755:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841152 00000100:00100000:0.0:1787387971.169807:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387971.169815:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9921:x1874211971841152:12345-0@lo:5: 00002000:00080000:0.0:1787387971.169843:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787387971.169847:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787387971.170121:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9921:x1874211971841152:12345-0@lo:5: Request processed in 306us (659us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787387971.170128:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787387971.170155:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bfb80 x1874211971841152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.170166:0:9921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971841152:0@lo:5: 00000004:00080000:0.0:1787387971.170174:0:9921:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787387971.170197:0:9921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971841280:0@lo:700: 00000100:00100000:0.0:1787387971.170223:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.170248:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841280 00000100:00100000:0.0:1787387971.170251:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841280 00000100:00100000:0.0:1787387971.170273:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387971.170280:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9921:x1874211971841280:12345-0@lo:700: 00000100:00100000:0.0:1787387971.170354:0:9921:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0300 going to sleep for 11 seconds 00000004:00080000:0.0:1787387971.178293:0:9915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787387971.178328:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971841536:0@lo:7: 00000100:00100000:0.0:1787387971.178404:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.178449:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.178465:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387971.178490:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971841408:0@lo:13: 00000100:00100000:0.0:1787387971.178518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.178549:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841408 00000100:00100000:0.0:1787387971.178564:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841408 00000100:00100000:0.0:1787387971.178612:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387971.178621:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971841408:12345-0@lo:13: 00002000:00000024:0.0:1787387971.178670:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787387971.178740:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971841408:12345-0@lo:13: Request processed in 119us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.178746:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787387971.178787:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273d0f5f480 x1874211971841408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.178805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971841408:0@lo:13: 00000100:00100000:0.0:1787387971.178847:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841536 00000100:00100000:0.0:1787387971.178851:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841536 00000100:00100000:0.0:1787387971.178875:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387971.178882:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9915:x1874211971841536:12345-0@lo:7: 00002000:00080000:0.0:1787387971.189398:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787387971.189407:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787387971.192618:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9915:x1874211971841536:12345-0@lo:7: Request processed in 13725us (14204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.192633:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787387971.192816:0:9915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364df80 x1874211971841536/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.192833:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971841536:0@lo:7: 00000004:00080000:0.0:1787387971.192849:0:9915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787387971.192900:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971841664:0@lo:5: 00000100:00100000:0.0:1787387971.192959:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.192991:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841664 00000100:00100000:2.0:1787387971.192998:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841664 00000100:00100000:0.0:1787387971.193010:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.193046:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000001:00080000:1.0:1787387971.194945:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787387971.195067:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9915:x1874211971841664:12345-0@lo:5: 00002000:00080000:0.0:1787387971.195136:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787387971.195203:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9915:x1874211971841664:12345-0@lo:5: Request processed in 2148us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.195211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787387971.195253:0:9915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc6680 x1874211971841664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.195281:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971841664:0@lo:5: 00000004:00080000:0.0:1787387971.195293:0:9915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787387971.195328:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971841792:0@lo:5: 00000100:00100000:0.0:1787387971.195359:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.195380:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.195395:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841792 00000100:00100000:0.0:1787387971.195400:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841792 00000100:00100000:0.0:1787387971.195434:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387971.195442:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9915:x1874211971841792:12345-0@lo:5: 00002000:00080000:0.0:1787387971.195465:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1787387971.198332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9915:x1874211971841792:12345-0@lo:5: Request processed in 2884us (2966us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787387971.198345:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787387971.198868:0:9915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc6680 x1874211971841792/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.198886:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9915:1874211971841792:0@lo:5: 00000004:00080000:1.0:1787387971.198900:0:9915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787387971.198937:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9915:1874211971841920:0@lo:900: 00000100:00100000:1.0:1787387971.198975:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.199014:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.199033:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971841920 00000100:00100000:1.0:1787387971.199039:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971841920 00000100:00100000:1.0:1787387971.199089:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387971.199106:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9915:x1874211971841920:12345-0@lo:900: 00000100:00100000:1.0:1787387971.199151:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9915:x1874211971841920:12345-0@lo:900: Request processed in 46us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.199158:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787387971.199184:0:9915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2713800 x1874211971841920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.199193:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9915:1874211971841920:0@lo:900: 00000100:00100000:3.0:1787387971.199564:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9921:x1874211971841280:12345-0@lo:700: Request processed in 29282us (29337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.199580:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787387971.199648:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34be300 x1874211971841280/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387971.200174:0:9921:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787387971.200192:0:9921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971841280:0@lo:700: 00000004:02000040:1.0:1787387971.202030:0:9921:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1787387971.212813:0:9921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971842048:0@lo:5: 00000100:00100000:1.0:1787387971.212894:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.212951:0:9921:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.213097:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842048 00000100:00100000:2.0:1787387971.213105:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842048 00000100:00100000:2.0:1787387971.213168:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787387971.213178:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9921:x1874211971842048:12345-0@lo:5: 00002000:00080000:2.0:1787387971.221141:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787387971.221162:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787387971.223252:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9921:x1874211971842048:12345-0@lo:5: Request processed in 10068us (10351us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787387971.223270:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787387971.223393:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2713800 x1874211971842048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387971.223412:0:9921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9921:1874211971842048:0@lo:5: 00000004:00080000:1.0:1787387971.223428:0:9921:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1787387971.276406:0:9939:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387971.276852:0:9939:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787387971.721937:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787387972.169899:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787387972.169920:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787387972.744274:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387973.767824:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387974.152174:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971842176:0@lo:13: 00000100:00100000:2.0:1787387974.152312:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.152415:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842176 00000100:00100000:2.0:1787387974.152426:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842176 00000100:00100000:2.0:1787387974.152503:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387974.152514:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971842176:12345-0@lo:13: 00002000:00000024:2.0:1787387974.152546:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387974.152592:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971842176:12345-0@lo:13: Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.152600:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787387974.152625:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387974.152665:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5880 x1874211971842176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387974.152714:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971842176:0@lo:13: 00000100:00100000:2.0:1787387974.153048:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971842304:0@lo:13: 00000100:00100000:2.0:1787387974.153085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.153226:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842304 00000100:00100000:0.0:1787387974.153232:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842304 00000100:00100000:0.0:1787387974.153274:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387974.153282:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971842304:12345-0@lo:13: 00002000:00000024:0.0:1787387974.153295:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387974.153330:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971842304:12345-0@lo:13: Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.153337:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787387974.153620:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387974.153645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7100 x1874211971842304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387974.153662:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971842304:0@lo:13: 00000020:00000004:0.0:1787387974.255082:0:10040:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387974.255391:0:10040:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787387974.664632:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971842432:0@lo:41: 00000100:00100000:0.0:1787387974.664788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387974.665052:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842432 00000100:00100000:1.0:1787387974.665063:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842432 00000100:00100000:1.0:1787387974.665287:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787387974.665297:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971842432:12345-0@lo:41: 00000004:00000024:1.0:1787387974.665332:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787387974.665394:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971842432:12345-0@lo:41: Request processed in 98us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.665402:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787387974.665767:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971842432:0@lo:41: 00010000:00010000:0.0:1787387974.791954:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787387975.348876:0:10088:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387975.348892:0:10088:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787387975.819124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387975.825928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387975.826149:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952918656 00000100:00100000:1.0:1787387975.826160:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952918656 00000100:00100000:1.0:1787387975.826799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 180 00000100:00100000:1.0:1787387975.826810:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1874211952918656:12345-192.168.204.52@tcp:250: 00010000:00080000:1.0:1787387975.826842:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a8423a62-2514-4436-ad30-fa5cd6699d5c@192.168.204.52@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:1.0:1787387975.826874:0:6515:0:(genops.c:1406:class_connect()) connect: client a8423a62-2514-4436-ad30-fa5cd6699d5c, cookie 0x5cb77467b1811a67 00000100:00080000:1.0:1787387975.827056:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9273fbf3a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387975.827145:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+5:2400:x1874211952918656:12345-192.168.204.52@tcp:250: Request processed in 334us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.827153:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 180 00000100:00100000:3.0:1787387975.829853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387975.840180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952918784 00000100:00100000:2.0:1787387975.840202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952918784 00000100:00100000:2.0:1787387975.840320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 181 00000100:00100000:2.0:1787387975.840334:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+5:6160:x1874211952918784:12345-192.168.204.52@tcp:101: 00010000:00010000:2.0:1787387975.840359:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387975.840388:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4b2a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387975.840425:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387975.840438:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387975.840450:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff200, rc 0) 00000100:00100000:2.0:1787387975.840876:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+6:6160:x1874211952918784:12345-192.168.204.52@tcp:101: Request processed in 543us (11031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387975.840885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 181 00000100:00100000:3.0:1787387975.845565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387975.845745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952918912 00000100:00100000:2.0:1787387975.845756:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952918912 00000100:00100000:2.0:1787387975.845811:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 182 00000100:00100000:2.0:1787387975.845822:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+6:6160:x1874211952918912:12345-192.168.204.52@tcp:501: 00000100:00100000:2.0:1787387975.845961:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+6:6160:x1874211952918912:12345-192.168.204.52@tcp:501: Request processed in 141us (407us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387975.845970:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 182 00000100:00100000:3.0:1787387975.857916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387975.858078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919040 00000100:00100000:2.0:1787387975.858090:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919040 00000100:00100000:2.0:1787387975.858154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 183 00000100:00100000:2.0:1787387975.858172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+6:6160:x1874211952919040:12345-192.168.204.52@tcp:101: 00010000:00010000:2.0:1787387975.858209:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387975.858229:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4b31 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387975.858262:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387975.858275:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387975.858284:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fea00, rc 0) 00000100:00100000:2.0:1787387975.858349:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+7:6160:x1874211952919040:12345-192.168.204.52@tcp:101: Request processed in 178us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387975.858357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 183 00000100:00100000:3.0:1787387975.868039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387975.869768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919168 00000100:00100000:0.0:1787387975.869785:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919168 00000100:00100000:0.0:1787387975.870069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 184 00000100:00100000:0.0:1787387975.870083:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+7:6160:x1874211952919168:12345-192.168.204.52@tcp:501: 00000100:00100000:0.0:1787387975.870273:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6160:x1874211952919168:12345-192.168.204.52@tcp:501: Request processed in 193us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.870282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 184 00000100:00100000:3.0:1787387975.874327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387975.874883:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919296 00000100:00100000:1.0:1787387975.874895:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919296 00000100:00100000:1.0:1787387975.874969:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 185 00000100:00100000:1.0:1787387975.874980:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6160:x1874211952919296:12345-192.168.204.52@tcp:503: 00000100:00100000:1.0:1787387975.876303:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6160:x1874211952919296:12345-192.168.204.52@tcp:503: Request processed in 1314us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.876317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 185 00000100:00100000:3.0:1787387975.900195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387975.901528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919424 00000100:00100000:2.0:1787387975.901541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919424 00000100:00100000:3.0:1787387975.902393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 186 00000100:00100000:3.0:1787387975.902406:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6178:x1874211952919424:12345-192.168.204.52@tcp:502: 00000100:00100000:3.0:1787387975.902599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6178:x1874211952919424:12345-192.168.204.52@tcp:502: Request processed in 193us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387975.902608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 186 00000100:00100000:3.0:1787387975.942552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387975.942757:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919552 00000100:00100000:0.0:1787387975.942774:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919552 00000100:00100000:0.0:1787387975.942839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 187 00000100:00100000:0.0:1787387975.942850:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6178:x1874211952919552:12345-192.168.204.52@tcp:502: 00000100:00100000:0.0:1787387975.943043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6178:x1874211952919552:12345-192.168.204.52@tcp:502: Request processed in 193us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.943052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 187 00000100:00100000:2.0:1787387975.947649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387975.947926:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919680 00000100:00100000:3.0:1787387975.947938:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919680 00000100:00100000:3.0:1787387975.947999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 188 00000100:00100000:3.0:1787387975.948009:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6160:x1874211952919680:12345-192.168.204.52@tcp:101: 00010000:00010000:3.0:1787387975.948026:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387975.948044:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152a200/0x5cb77467b1811a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4b62 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387975.948094:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a200/0x5cb77467b1811a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b62 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387975.948105:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152a200/0x5cb77467b1811a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b62 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387975.948114:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152a200, rc 0) 00000100:00100000:3.0:1787387975.949337:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6160:x1874211952919680:12345-192.168.204.52@tcp:101: Request processed in 169us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387975.949354:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 188 00000100:00100000:3.0:1787387975.955157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387975.955267:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919808 00000100:00100000:1.0:1787387975.955277:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919808 00000100:00100000:1.0:1787387975.955342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 189 00000100:00100000:1.0:1787387975.955352:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6160:x1874211952919808:12345-192.168.204.52@tcp:256: 20000000:01000000:1.0:1787387975.956057:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787387975.956086:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787387975.956091:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787387975.956094:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787387975.956097:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787387975.956100:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787387975.959611:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6160:x1874211952919808:12345-192.168.204.52@tcp:256: Request processed in 4248us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.959634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 189 00000100:00100000:2.0:1787387975.964999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387975.966288:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952919936 00000100:00100000:3.0:1787387975.966304:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952919936 00000100:00100000:3.0:1787387975.966377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 190 00000100:00100000:3.0:1787387975.966388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6160:x1874211952919936:12345-192.168.204.52@tcp:101: 00010000:00010000:3.0:1787387975.966406:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387975.966426:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4b69 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387975.966456:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387975.966469:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387975.966478:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152b800, rc 0) 00000100:00100000:3.0:1787387975.966549:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6160:x1874211952919936:12345-192.168.204.52@tcp:101: Request processed in 163us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387975.966570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 190 00000100:00100000:3.0:1787387975.969781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387975.969881:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920064 00000100:00100000:0.0:1787387975.969893:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920064 00000100:00100000:0.0:1787387975.969961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 191 00000100:00100000:0.0:1787387975.969971:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6160:x1874211952920064:12345-192.168.204.52@tcp:501: 00000100:00100000:0.0:1787387975.970144:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6160:x1874211952920064:12345-192.168.204.52@tcp:501: Request processed in 174us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.970152:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 191 00000100:00100000:1.0:1787387975.975279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387975.975587:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920192 00000100:00100000:0.0:1787387975.975597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920192 00000100:00100000:0.0:1787387975.975656:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 192 00000100:00100000:0.0:1787387975.975666:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6160:x1874211952920192:12345-192.168.204.52@tcp:503: 00000100:00100000:0.0:1787387975.976123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6160:x1874211952920192:12345-192.168.204.52@tcp:503: Request processed in 456us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.976131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 192 00000100:00100000:2.0:1787387975.984675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387975.987995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920320 00000100:00100000:3.0:1787387975.988019:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920320 00000100:00100000:2.0:1787387975.988506:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 193 00000100:00100000:2.0:1787387975.988519:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6184:x1874211952920320:12345-192.168.204.52@tcp:502: 00000100:00100000:2.0:1787387975.988723:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6184:x1874211952920320:12345-192.168.204.52@tcp:502: Request processed in 206us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387975.988731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 193 00000100:00100000:0.0:1787387975.997308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387975.999084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920448 00000100:00100000:2.0:1787387975.999101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920448 00000100:00100000:2.0:1787387975.999192:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 194 00000100:00100000:2.0:1787387975.999203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6184:x1874211952920448:12345-192.168.204.52@tcp:502: 00000100:00100000:2.0:1787387975.999382:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6184:x1874211952920448:12345-192.168.204.52@tcp:502: Request processed in 180us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387975.999391:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 194 00000100:00100000:3.0:1787387976.004792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.004823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387976.005067:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920576 00000100:00100000:0.0:1787387976.005078:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920576 00000100:00100000:0.0:1787387976.005130:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920832 00000100:00100000:0.0:1787387976.005133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920832 00000100:00100000:0.0:1787387976.005159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:2.0:1787387976.005251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:0.0:1787387976.005253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874211952920576:12345-192.168.204.52@tcp:38: 00000100:00100000:2.0:1787387976.005258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1874211952920832:12345-192.168.204.52@tcp:38: 00010000:00080000:0.0:1787387976.005287:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787387976.005370:0:6520:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b1811a8a 00000004:00100000:0.0:1787387976.005401:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 76 00000100:00080000:0.0:1787387976.007709:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9272c36cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387976.007801:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952920576:12345-192.168.204.52@tcp:38: Request processed in 2549us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387976.007811:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00010000:00080000:2.0:1787387976.011635:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1787387976.011863:0:6522:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b1811a91 00000004:00100000:2.0:1787387976.011892:0:6522:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 76 00000100:00080000:2.0:1787387976.012123:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9272c2f64000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387976.013328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952920832:12345-192.168.204.52@tcp:38: Request processed in 8061us (8495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.013341:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:0.0:1787387976.200466:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971842560:0@lo:13: 00000100:00100000:0.0:1787387976.200551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387976.200698:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842560 00000100:00100000:0.0:1787387976.200706:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842560 00000100:00100000:0.0:1787387976.200760:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387976.200769:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971842560:12345-0@lo:13: 00002000:00000024:0.0:1787387976.200813:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387976.200863:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971842560:12345-0@lo:13: Request processed in 94us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387976.200882:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387976.200921:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971842944:0@lo:400: 00000100:00080000:2.0:1787387976.200925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387976.200941:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971842688:0@lo:400: 00000100:00100000:0.0:1787387976.200957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387976.201048:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971842816:0@lo:400: 00000100:00100000:1.0:1787387976.201850:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842944 00000100:00100000:1.0:1787387976.201858:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842944 00000100:00100000:1.0:1787387976.201894:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787387976.201912:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971842944:12345-0@lo:400: 00000100:00100000:2.0:1787387976.202101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.202150:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971843200:0@lo:400: 00000100:00100000:2.0:1787387976.202185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.202205:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971843712:0@lo:400: 00000100:00100000:2.0:1787387976.202228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.202251:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971844224:0@lo:41: 00000100:00100000:2.0:1787387976.202272:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.202283:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387976.202288:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971844352:0@lo:13: 00000100:00100000:2.0:1787387976.202312:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.202356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843200 00000100:00100000:2.0:1787387976.202360:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843200 00000100:00100000:2.0:1787387976.202380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844224 00000100:00100000:2.0:1787387976.202383:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844224 00000100:00100000:2.0:1787387976.202396:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387976.202563:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971843200:12345-0@lo:400: 00000100:00100000:2.0:1787387976.202610:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971843200:12345-0@lo:400: Request processed in 207us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.202617:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387976.202644:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787387976.202651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971844224:12345-0@lo:41: 00000004:00000024:2.0:1787387976.202695:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787387976.202932:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971844224:12345-0@lo:41: Request processed in 281us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.202939:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787387976.202969:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844352 00000100:00100000:2.0:1787387976.202973:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844352 00000100:00100000:2.0:1787387976.203006:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387976.203012:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971844352:12345-0@lo:13: 00002000:00000024:2.0:1787387976.203024:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387976.203051:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971844352:12345-0@lo:13: Request processed in 39us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.203057:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787387976.203072:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387976.203083:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843712 00000100:00100000:2.0:1787387976.203086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843712 00000100:00100000:2.0:1787387976.203116:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787387976.203123:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971843712:12345-0@lo:400: 00000100:00100000:2.0:1787387976.203226:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971843712:12345-0@lo:400: Request processed in 103us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.203232:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787387976.203248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787387976.203275:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2711c00 x1874211971844352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387976.203285:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787387976.203308:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971844352:0@lo:13: 00000100:00100000:2.0:1787387976.203321:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971844224:0@lo:41: 00000100:00100000:2.0:1787387976.203332:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971843200:0@lo:400: 00010000:00080000:2.0:1787387976.203342:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c6d80 x1874211971843712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387976.203351:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971843712:0@lo:400: 00000100:00100000:2.0:1787387976.203377:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842688 00000100:00100000:2.0:1787387976.203381:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842688 00000100:00100000:0.0:1787387976.203554:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971843456:0@lo:400: 00000100:00100000:0.0:1787387976.203586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387976.203603:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971843968:0@lo:400: 00000100:00100000:0.0:1787387976.203638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387976.203659:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787387976.203674:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971843072:0@lo:400: 00000100:00100000:0.0:1787387976.203717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387976.203736:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971843584:0@lo:400: 00000100:00100000:0.0:1787387976.203766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.204012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787387976.204021:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971842688:12345-0@lo:400: 00000100:00100000:2.0:1787387976.204062:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971842688:12345-0@lo:400: Request processed in 42us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.204068:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787387976.204109:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971842688:0@lo:400: 00000100:00100000:2.0:1787387976.204155:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843968 00000100:00100000:2.0:1787387976.204160:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843968 00000100:00100000:2.0:1787387976.204183:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843072 00000100:00100000:2.0:1787387976.204193:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843072 00000100:00100000:2.0:1787387976.204205:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843584 00000100:00100000:2.0:1787387976.204207:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843584 00000100:00100000:2.0:1787387976.204221:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387976.204226:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971843968:12345-0@lo:400: 00000100:00100000:2.0:1787387976.204262:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971843968:12345-0@lo:400: Request processed in 35us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.204268:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387976.204279:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387976.204284:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971843072:12345-0@lo:400: 00000100:00100000:2.0:1787387976.204308:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971843072:12345-0@lo:400: Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.204314:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387976.204324:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787387976.204330:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971843584:12345-0@lo:400: 00000100:00100000:2.0:1787387976.204353:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971843584:12345-0@lo:400: Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.204359:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787387976.204371:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387976.204375:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787387976.204396:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843456 00000100:00100000:2.0:1787387976.204399:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843456 00000100:00100000:2.0:1787387976.204552:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387976.204560:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971843456:12345-0@lo:400: 00000100:00100000:2.0:1787387976.204593:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971843456:12345-0@lo:400: Request processed in 35us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.204599:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787387976.204614:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387976.204738:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4000 x1874211971842560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387976.204864:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787387976.204882:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971842560:0@lo:13: 00010000:00080000:0.0:1787387976.204997:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c7800 x1874211971843584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387976.205006:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971843584:0@lo:400: 00000100:00100000:0.0:1787387976.205015:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971844096:0@lo:400: 00000100:00100000:0.0:1787387976.205044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787387976.205078:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c7100 x1874211971843456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387976.205087:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971843456:0@lo:400: 00010000:00080000:0.0:1787387976.205097:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c7480 x1874211971843968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387976.205104:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971843968:0@lo:400: 00010000:00080000:0.0:1787387976.205124:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c6680 x1874211971843072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387976.205131:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971843072:0@lo:400: 00000100:00100000:3.0:1787387976.205220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387976.205242:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971843328:0@lo:400: 00000100:00100000:3.0:1787387976.205264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387976.205281:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971843840:0@lo:400: 00000100:00100000:3.0:1787387976.205300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387976.205325:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844096 00000100:00100000:3.0:1787387976.205330:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844096 00000100:00100000:3.0:1787387976.205352:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843328 00000100:00100000:3.0:1787387976.205355:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843328 00000100:00100000:3.0:1787387976.205373:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387976.205378:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971844096:12345-0@lo:400: 00000100:00100000:3.0:1787387976.205423:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971844096:12345-0@lo:400: Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.205430:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387976.205443:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387976.205449:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971843328:12345-0@lo:400: 00000100:00100000:3.0:1787387976.205479:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971843328:12345-0@lo:400: Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.205485:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787387976.205520:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387976.205529:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971842816 00000100:00100000:3.0:1787387976.205532:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971842816 00000100:00100000:3.0:1787387976.205551:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971843840 00000100:00100000:3.0:1787387976.205554:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971843840 00000100:00100000:3.0:1787387976.205571:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787387976.205577:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971842816:12345-0@lo:400: 00000100:00100000:3.0:1787387976.205608:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971842816:12345-0@lo:400: Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.205614:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787387976.205638:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787387976.205644:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971843840:12345-0@lo:400: 00000100:00100000:3.0:1787387976.205671:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971843840:12345-0@lo:400: Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.205692:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787387976.205706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387976.205729:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4700 x1874211971842816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387976.205739:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971842816:0@lo:400: 00010000:00080000:3.0:1787387976.205761:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5500 x1874211971843328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387976.205768:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971843328:0@lo:400: 00000100:00100000:1.0:1787387976.205865:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971842944:12345-0@lo:400: Request processed in 3962us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387976.205874:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787387976.206911:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5c00 x1874211971843840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387976.206930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971843840:0@lo:400: 00010000:00080000:0.0:1787387976.207196:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4e00 x1874211971844096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387976.207208:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971844096:0@lo:400: 00000100:00100000:0.0:1787387976.207222:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971842944:0@lo:400: 00000100:00100000:3.0:1787387976.762383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.763714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.767601:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387976.770414:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921088 00000100:00100000:2.0:1787387976.770442:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921088 00000100:00100000:2.0:1787387976.770582:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920704 00000100:00100000:2.0:1787387976.770585:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920704 00000100:00100000:2.0:1787387976.770611:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:2.0:1787387976.770620:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+7:6160:x1874211952921088:12345-192.168.204.52@tcp:41: 00000004:00000024:2.0:1787387976.770651:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787387976.770743:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+7:6160:x1874211952921088:12345-192.168.204.52@tcp:41: Request processed in 123us (8371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.770750:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:2.0:1787387976.770774:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:2.0:1787387976.770781:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952920704:12345-192.168.204.52@tcp:41: 00000004:00000024:2.0:1787387976.770791:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787387976.770810:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952920704:12345-192.168.204.52@tcp:41: Request processed in 30us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.770816:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00080000:1.0:1787387976.771281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387976.774865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387976.779770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952920960 00000100:00100000:0.0:1787387976.779804:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952920960 00000100:00100000:0.0:1787387976.779876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921216 00000100:00100000:0.0:1787387976.779880:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921216 00000100:00100000:0.0:1787387976.779916:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:0.0:1787387976.779926:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952920960:12345-192.168.204.52@tcp:41: 00000004:00000024:0.0:1787387976.779968:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1787387976.780122:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787387976.780157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:3.0:1787387976.780169:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:6160:x1874211952921216:12345-192.168.204.52@tcp:40: 00000100:00100000:3.0:1787387976.780251:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:6160:x1874211952921216:12345-192.168.204.52@tcp:40: Request processed in 85us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.780259:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:0.0:1787387976.780615:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952920960:12345-192.168.204.52@tcp:41: Request processed in 689us (13021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387976.780624:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:3.0:1787387976.788509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.788553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.788584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.788616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387976.788652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921472 00000100:00100000:2.0:1787387976.788663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921472 00000100:00100000:2.0:1787387976.788756:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 196 00000100:00100000:2.0:1787387976.788766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952921472:12345-192.168.204.52@tcp:400: 00000100:00100000:2.0:1787387976.788834:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952921472:12345-192.168.204.52@tcp:400: Request processed in 69us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.788858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 196 00000100:00100000:0.0:1787387976.789027:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921344 00000100:00100000:0.0:1787387976.789031:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921344 00000100:00100000:1.0:1787387976.789178:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921728 00000100:00100000:1.0:1787387976.789183:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921728 00000100:00100000:1.0:1787387976.789232:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:1.0:1787387976.789239:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74df45bd-a066-4da5-9401-b0a043132784+6:6160:x1874211952921728:12345-192.168.204.52@tcp:900: 00000100:00100000:1.0:1787387976.789293:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74df45bd-a066-4da5-9401-b0a043132784+6:6160:x1874211952921728:12345-192.168.204.52@tcp:900: Request processed in 55us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387976.789362:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:0.0:1787387976.791008:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921600 00000100:00100000:0.0:1787387976.791019:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921600 00000100:00100000:3.0:1787387976.791636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387976.791667:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921856 00000100:00100000:3.0:1787387976.791671:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921856 00000100:00100000:3.0:1787387976.791718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:3.0:1787387976.791727:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+6:6160:x1874211952921856:12345-192.168.204.52@tcp:33: 00000100:00100000:2.0:1787387976.795835:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:2.0:1787387976.795849:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874211952921344:12345-192.168.204.52@tcp:8: 00010000:00080000:2.0:1787387976.797002:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1787387976.797041:0:8437:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b1811a98 00002000:00100000:2.0:1787387976.797056:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74df45bd-a066-4da5-9401-b0a043132784/ffff9272c2f66000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787387976.797077:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 76 00002000:00080000:2.0:1787387976.797386:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787387976.798284:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9272c2f65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387976.798377:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952921344:12345-192.168.204.52@tcp:8: Request processed in 2526us (9820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.798387:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:1.0:1787387976.798729:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787387976.798739:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1874211952921600:12345-192.168.204.52@tcp:8: 00010000:00080000:1.0:1787387976.798769:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1787387976.798794:0:8435:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b1811a9f 00002000:00100000:1.0:1787387976.798806:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 74df45bd-a066-4da5-9401-b0a043132784/ffff9273fbf3e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387976.798817:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 76 00002000:00080000:1.0:1787387976.798994:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787387976.799016:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9273fbf38000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387976.799119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952921600:12345-192.168.204.52@tcp:8: Request processed in 378us (10532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387976.799127:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000004:00080000:0.0:1787387976.822754:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30939us 00010000:00010000:3.0:1787387976.840275:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1787387976.859565:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787387976.859696:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+6:6160:x1874211952921856:12345-192.168.204.52@tcp:33: Request processed in 67945us (68040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387976.859754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:2.0:1787387977.075363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387977.075507:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952921984 00000100:00100000:3.0:1787387977.075517:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952921984 00000100:00100000:3.0:1787387977.075591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:3.0:1787387977.075601:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:6203:x1874211952921984:12345-192.168.204.52@tcp:101: 00010000:00010000:3.0:1787387977.075621:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387977.075714:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152a400/0x5cb77467b1811aa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4b9a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387977.075798:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1811aad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387977.075813:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1811aad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387977.075825:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1811aad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387977.075896:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787387977.075901:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787387977.075919:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1811aad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387977.075946:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152a400/0x5cb77467b1811aa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b9a expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387977.075967:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1811aad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b9a expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387977.075975:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273fbd42d00) 00010000:00010000:3.0:1787387977.075983:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387977.075987:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152bc00, rc 0) 00000100:00100000:3.0:1787387977.076114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+7:6203:x1874211952921984:12345-192.168.204.52@tcp:101: Request processed in 513us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387977.076121:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 13 00010000:00010000:0.0:1787387977.864852:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387978.888005:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387979.116923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387979.119027:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922112 00000100:00100000:2.0:1787387979.119040:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922112 00000100:00100000:2.0:1787387979.119196:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:2.0:1787387979.119210:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+7:6255:x1874211952922112:12345-192.168.204.52@tcp:41: 00000004:00000024:2.0:1787387979.119266:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787387979.119350:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+7:6255:x1874211952922112:12345-192.168.204.52@tcp:41: Request processed in 144us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387979.119358:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00080000:3.0:1787387979.129056:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387979.129477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387979.134854:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922240 00000100:00100000:0.0:1787387979.134876:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922240 00000100:00100000:0.0:1787387979.135118:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:0.0:1787387979.135132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:6255:x1874211952922240:12345-192.168.204.52@tcp:41: 00000004:00000024:0.0:1787387979.135187:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787387979.135274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:6255:x1874211952922240:12345-192.168.204.52@tcp:41: Request processed in 146us (5803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387979.135301:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:0.0:1787387979.139729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387979.139886:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922368 00000100:00100000:1.0:1787387979.139897:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922368 00000100:00080000:2.0:1787387979.139970:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387979.139975:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787387979.143965:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:1.0:1787387979.143981:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74df45bd-a066-4da5-9401-b0a043132784+6:6255:x1874211952922368:12345-192.168.204.52@tcp:13: 00002000:00000024:1.0:1787387979.144014:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387979.144094:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74df45bd-a066-4da5-9401-b0a043132784+6:6255:x1874211952922368:12345-192.168.204.52@tcp:13: Request processed in 118us (4416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387979.144101:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:0.0:1787387979.152911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387979.153081:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922496 00000100:00100000:3.0:1787387979.153106:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922496 00000100:00100000:3.0:1787387979.153176:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:3.0:1787387979.153187:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74df45bd-a066-4da5-9401-b0a043132784+6:6255:x1874211952922496:12345-192.168.204.52@tcp:13: 00002000:00000024:3.0:1787387979.153225:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387979.153296:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74df45bd-a066-4da5-9401-b0a043132784+6:6255:x1874211952922496:12345-192.168.204.52@tcp:13: Request processed in 111us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387979.153305:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00080000:0.0:1787387979.153609:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387979.272399:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971844608:0@lo:13: 00000100:00100000:3.0:1787387979.272507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387979.272596:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387979.272603:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844608 00000100:00100000:3.0:1787387979.272606:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971844480:0@lo:13: 00000100:00100000:0.0:1787387979.272614:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844608 00000100:00100000:3.0:1787387979.272636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387979.272707:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844480 00000100:00100000:0.0:1787387979.272711:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844480 00000100:00100000:0.0:1787387979.272734:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387979.272743:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971844608:12345-0@lo:13: 00002000:00000024:0.0:1787387979.272837:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387979.272952:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387979.272964:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971844480:12345-0@lo:13: 00000100:00100000:0.0:1787387979.272971:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971844608:12345-0@lo:13: Request processed in 227us (461us total) trans 0 rc 0/0 00002000:00000024:3.0:1787387979.272978:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387979.272982:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387979.273018:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971844480:12345-0@lo:13: Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387979.273025:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787387979.273039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387979.273072:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c7b80 x1874211971844480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387979.273091:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971844480:0@lo:13: 00010000:00080000:3.0:1787387979.273103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd1c00 x1874211971844608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387979.273113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971844608:0@lo:13: 00000100:00100000:3.0:1787387979.784035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387979.784079:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971844736:0@lo:41: 00000100:00100000:3.0:1787387979.784148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387979.784268:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844736 00000100:00100000:0.0:1787387979.784276:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844736 00000100:00100000:0.0:1787387979.784331:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787387979.784340:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971844736:12345-0@lo:41: 00000004:00000024:0.0:1787387979.784368:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787387979.784414:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971844736:12345-0@lo:41: Request processed in 74us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387979.784421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787387979.784464:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971844736:0@lo:41: 00010000:00010000:2.0:1787387979.913522:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787387980.810463:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00010000:00010000:0.0:1787387980.936181:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387981.319901:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387981.319928:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971844864:0@lo:13: 00000100:00100000:2.0:1787387981.319993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320220:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844864 00000100:00100000:0.0:1787387981.320227:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844864 00000100:00100000:0.0:1787387981.320283:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387981.320308:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971844864:12345-0@lo:13: 00002000:00000024:0.0:1787387981.320337:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387981.320398:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971844864:12345-0@lo:13: Request processed in 94us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.320407:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787387981.320429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387981.320463:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c7b80 x1874211971844864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.320494:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971844864:0@lo:13: 00000100:00100000:0.0:1787387981.320605:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971845376:0@lo:400: 00000100:00100000:0.0:1787387981.320633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320652:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971845888:0@lo:400: 00000100:00100000:0.0:1787387981.320720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320739:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971846400:0@lo:400: 00000100:00100000:0.0:1787387981.320764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320784:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787387981.320790:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971845248:0@lo:400: 00000100:00100000:0.0:1787387981.320823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320843:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971845760:0@lo:400: 00000100:00100000:0.0:1787387981.320864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320879:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971846272:0@lo:400: 00000100:00100000:0.0:1787387981.320899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.320925:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845376 00000100:00100000:0.0:1787387981.320930:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845376 00000100:00100000:0.0:1787387981.320961:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787387981.320969:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971845376:12345-0@lo:400: 00000100:00100000:0.0:1787387981.321014:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971845376:12345-0@lo:400: Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.321020:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787387981.321036:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845888 00000100:00100000:0.0:1787387981.321039:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845888 00000100:00100000:0.0:1787387981.321063:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845760 00000100:00100000:0.0:1787387981.321066:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845760 00000100:00100000:0.0:1787387981.321094:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387981.321100:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971845888:12345-0@lo:400: 00000100:00100000:0.0:1787387981.321128:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971845888:12345-0@lo:400: Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.321134:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387981.321145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387981.321150:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971845760:12345-0@lo:400: 00000100:00100000:0.0:1787387981.321175:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971845760:12345-0@lo:400: Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.321181:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387981.321197:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846400 00000100:00100000:0.0:1787387981.321200:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846400 00000100:00100000:0.0:1787387981.321222:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845248 00000100:00100000:0.0:1787387981.321225:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845248 00000100:00100000:0.0:1787387981.321235:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846272 00000100:00100000:0.0:1787387981.321237:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846272 00000100:00100000:0.0:1787387981.321249:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787387981.321255:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971846400:12345-0@lo:400: 00000100:00100000:0.0:1787387981.321295:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971846400:12345-0@lo:400: Request processed in 40us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.321302:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787387981.321319:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787387981.321324:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971845248:12345-0@lo:400: 00000100:00100000:0.0:1787387981.321350:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971845248:12345-0@lo:400: Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.321355:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787387981.321365:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787387981.321370:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971846272:12345-0@lo:400: 00000100:00100000:0.0:1787387981.321393:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971846272:12345-0@lo:400: Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.321399:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787387981.321439:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971845248:0@lo:400: 00010000:00080000:0.0:1787387981.321451:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3618380 x1874211971845760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.321461:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971845760:0@lo:400: 00000100:00100000:0.0:1787387981.321472:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971846272:0@lo:400: 00000100:00100000:0.0:1787387981.321480:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971845376:0@lo:400: 00010000:00080000:0.0:1787387981.321488:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3619f80 x1874211971845888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.321496:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971845888:0@lo:400: 00010000:00080000:0.0:1787387981.321505:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c361aa00 x1874211971846400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.321512:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971846400:0@lo:400: 00000100:00080000:0.0:1787387981.321537:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387981.321546:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787387981.321549:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387981.321905:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971845120:0@lo:400: 00000100:00100000:3.0:1787387981.321945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.321978:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971845632:0@lo:400: 00000100:00100000:3.0:1787387981.322002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971846144:0@lo:400: 00000100:00100000:3.0:1787387981.322042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971846656:0@lo:41: 00000100:00100000:3.0:1787387981.322090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322109:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787387981.322115:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971844992:0@lo:13: 00000100:00100000:3.0:1787387981.322139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322153:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971845504:0@lo:400: 00000100:00100000:3.0:1787387981.322170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322182:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971846016:0@lo:400: 00000100:00100000:3.0:1787387981.322197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322210:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971846528:0@lo:400: 00000100:00100000:3.0:1787387981.322243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.322272:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846144 00000100:00100000:3.0:1787387981.322276:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846144 00000100:00100000:3.0:1787387981.322309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845504 00000100:00100000:3.0:1787387981.322312:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845504 00000100:00100000:3.0:1787387981.322321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846016 00000100:00100000:3.0:1787387981.322322:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846016 00000100:00100000:3.0:1787387981.322335:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387981.322341:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971846144:12345-0@lo:400: 00000100:00100000:3.0:1787387981.322400:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971846144:12345-0@lo:400: Request processed in 58us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.322407:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387981.322420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387981.322426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971845504:12345-0@lo:400: 00000100:00100000:3.0:1787387981.322454:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971845504:12345-0@lo:400: Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.322459:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387981.322630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787387981.322638:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971846016:12345-0@lo:400: 00000100:00100000:3.0:1787387981.322668:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971846016:12345-0@lo:400: Request processed in 32us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.322674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787387981.322714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845120 00000100:00100000:3.0:1787387981.322718:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845120 00000100:00100000:3.0:1787387981.322741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787387981.322748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971845120:12345-0@lo:400: 00000100:00100000:3.0:1787387981.322777:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971845120:12345-0@lo:400: Request processed in 29us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.322782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787387981.322819:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971845632 00000100:00100000:3.0:1787387981.322823:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971845632 00000100:00100000:3.0:1787387981.322843:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846656 00000100:00100000:3.0:1787387981.322845:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846656 00000100:00100000:3.0:1787387981.322857:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787387981.322863:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971845632:12345-0@lo:400: 00000100:00100000:3.0:1787387981.322895:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971845632:12345-0@lo:400: Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.322907:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787387981.322919:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387981.322924:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971846656:12345-0@lo:41: 00000004:00000024:3.0:1787387981.322948:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787387981.322975:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971846656:12345-0@lo:41: Request processed in 52us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.322980:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387981.323004:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971844992 00000100:00100000:3.0:1787387981.323007:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971844992 00000100:00100000:3.0:1787387981.323029:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387981.323036:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971844992:12345-0@lo:13: 00002000:00000024:3.0:1787387981.323059:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387981.323220:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971844992:12345-0@lo:13: Request processed in 184us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.323228:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387981.323253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846528 00000100:00100000:3.0:1787387981.323256:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846528 00000100:00100000:3.0:1787387981.323278:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387981.323284:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971846528:12345-0@lo:400: 00000100:00100000:3.0:1787387981.323313:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971846528:12345-0@lo:400: Request processed in 29us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.323320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787387981.323336:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387981.323342:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387981.323344:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787387981.323847:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd1c00 x1874211971844992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387981.323882:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971844992:0@lo:13: 00000100:00100000:2.0:1787387981.324797:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971845504:0@lo:400: 00000100:00100000:2.0:1787387981.324827:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971846016:0@lo:400: 00010000:00080000:2.0:1787387981.324841:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3618700 x1874211971846528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387981.324851:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971846528:0@lo:400: 00000100:00100000:2.0:1787387981.324861:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971845120:0@lo:400: 00000100:00100000:2.0:1787387981.324872:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971845632:0@lo:400: 00010000:00080000:2.0:1787387981.324884:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3619880 x1874211971846144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387981.324892:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971846144:0@lo:400: 00000100:00100000:2.0:1787387981.324909:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971846656:0@lo:41: 00000001:02000400:2.0:1787387981.735198:0:10186:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787387981.835068:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000001:00100000:0.0:1787387981.835167:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00010000:00010000:0.0:1787387981.961708:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387982.166499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387982.166643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387982.166706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387982.166742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387982.166770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387982.166829:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922880 00000100:00100000:0.0:1787387982.166839:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922880 00000100:00100000:0.0:1787387982.166895:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922752 00000100:00100000:0.0:1787387982.166899:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922752 00000100:00100000:0.0:1787387982.166926:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:0.0:1787387982.166936:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952922880:12345-192.168.204.52@tcp:400: 00000100:00100000:0.0:1787387982.167018:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952922880:12345-192.168.204.52@tcp:400: Request processed in 82us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387982.167027:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:0.0:1787387982.167046:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:0.0:1787387982.167053:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952922752:12345-192.168.204.52@tcp:400: 00000100:00100000:0.0:1787387982.167080:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952922752:12345-192.168.204.52@tcp:400: Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387982.167087:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00080000:1.0:1787387982.168415:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387982.168424:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787387982.168709:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923136 00000100:00100000:2.0:1787387982.168718:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923136 00000100:00100000:2.0:1787387982.168795:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923008 00000100:00100000:2.0:1787387982.168799:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923008 00000100:00100000:2.0:1787387982.168824:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:2.0:1787387982.168833:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952923136:12345-192.168.204.52@tcp:400: 00000100:00100000:2.0:1787387982.168902:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952923136:12345-192.168.204.52@tcp:400: Request processed in 71us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387982.168926:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:2.0:1787387982.168944:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:2.0:1787387982.168950:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952923008:12345-192.168.204.52@tcp:400: 00000100:00100000:2.0:1787387982.168980:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952923008:12345-192.168.204.52@tcp:400: Request processed in 30us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387982.168987:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00080000:1.0:1787387982.170981:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387982.170992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387982.175636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952922624 00000100:00100000:3.0:1787387982.175653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952922624 00000100:00100000:3.0:1787387982.175768:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 198 00000100:00100000:3.0:1787387982.175779:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952922624:12345-192.168.204.52@tcp:400: 00000100:00100000:3.0:1787387982.175868:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952922624:12345-192.168.204.52@tcp:400: Request processed in 90us (9382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387982.175876:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 198 00000001:00100000:2.0:1787387982.858973:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00010000:00010000:2.0:1787387982.985361:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387984.008875:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387984.393381:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387984.393412:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971846784:0@lo:13: 00000100:00100000:3.0:1787387984.393483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387984.393674:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846784 00000100:00100000:0.0:1787387984.393703:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846784 00000100:00100000:0.0:1787387984.393773:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387984.393783:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971846784:12345-0@lo:13: 00002000:00000024:0.0:1787387984.393824:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387984.393869:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971846784:12345-0@lo:13: Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387984.393891:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787387984.393913:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387984.394080:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3618380 x1874211971846784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387984.394099:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971846784:0@lo:13: 00000100:00100000:1.0:1787387984.395216:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387984.395252:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971846912:0@lo:13: 00000100:00100000:1.0:1787387984.395314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387984.395433:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971846912 00000100:00100000:0.0:1787387984.395441:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971846912 00000100:00100000:0.0:1787387984.395496:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387984.395505:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971846912:12345-0@lo:13: 00002000:00000024:0.0:1787387984.395522:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387984.395667:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971846912:12345-0@lo:13: Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387984.395675:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787387984.395781:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4e00 x1874211971846912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387984.395799:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971846912:0@lo:13: 00000100:00080000:1.0:1787387984.399037:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387984.906595:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387984.906623:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971847040:0@lo:41: 00000100:00100000:3.0:1787387984.906766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387984.906818:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971847040 00000100:00100000:0.0:1787387984.906827:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971847040 00000100:00100000:0.0:1787387984.906882:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787387984.906892:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971847040:12345-0@lo:41: 00000004:00000024:0.0:1787387984.906934:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787387984.907009:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971847040:12345-0@lo:41: Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387984.907017:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787387984.907147:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971847040:0@lo:41: 00010000:00010000:0.0:1787387985.034237:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787387985.465650:0:10334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffe11dc460 00000020:00000080:3.0:1787387985.465667:0:10334:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787387985.465671:0:10334:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787387985.465823:0:10334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe11de6f0 20000000:00000080:3.0:1787387985.465833:0:10334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9272c36bc000 uarg=0000000000000000 20000000:01000000:3.0:1787387985.465877:0:10334:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787387985.465879:0:10334:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787387985.465882:0:10334:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787387985.465892:0:10334:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787387985.465898:0:10334:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787387985.466131:0:10334:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787387985.466134:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387985.466892:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787387985.467578:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787387985.467612:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787387985.467629:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1787387985.467639:0:10334:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787387985.467641:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387985.468521:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787387985.468872:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1787387985.468909:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1787387985.469142:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1787387985.469156:0:10334:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787387985.469159:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387985.470467:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1787387985.470842:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1787387985.470873:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1787387985.470888:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1787387985.470900:0:10334:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787387985.470902:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387985.471563:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1787387985.472183:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1787387985.472275:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1787387985.472288:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1787387985.472298:0:10334:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787387985.472300:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387985.472888:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1787387985.473335:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1787387985.473494:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1787387985.473517:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:0.0:1787387985.473534:0:10334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787387985.473555:0:10334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473576:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473584:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811972 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473592:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473598:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119bf expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473622:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119cd expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473630:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473637:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473645:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473652:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473662:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473669:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.473863:0:10334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.474120:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.474137:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 9 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.474154:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847168:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787387985.474450:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.474460:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 9 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.474469:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847296:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787387985.475837:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.475853:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.475864:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847424:0@lo:104: 00000100:00100000:1.0:1787387985.475920:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.478124:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971847424 00000100:00100000:2.0:1787387985.478141:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971847424 00000100:00100000:2.0:1787387985.478218:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387985.478229:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:10334:x1874211971847424:12345-0@lo:104: 00010000:00010000:2.0:1787387985.478244:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.478327:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387985.478332:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:10334:x1874211971847424:12345-0@lo:104: Request processed in 107us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.478340:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787387985.478841:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.478855:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.478884:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847552:0@lo:104: 00000100:00100000:1.0:1787387985.478927:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387985.478971:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.478981:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 23 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.478989:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847680:0@lo:104: 00000100:00100000:1.0:1787387985.479011:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387985.479027:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.479035:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 23 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.479043:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847808:0@lo:104: 00000100:00100000:1.0:1787387985.479068:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387985.479085:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18119cd expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.479093:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18119cd expref: 23 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.479101:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847936:0@lo:104: 00010000:00010000:1.0:1787387985.479124:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18119bf expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.479143:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18119bf expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.479152:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848064:0@lo:104: 00010000:00010000:1.0:1787387985.479178:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.479186:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 23 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.479313:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848192:0@lo:104: 00010000:00010000:1.0:1787387985.479342:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811972 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.479350:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811972 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.479358:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848320:0@lo:104: 00010000:00010000:1.0:1787387985.479461:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.479470:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.479477:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848448:0@lo:104: 00000100:00100000:1.0:1787387985.479513:0:10334:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387985.479534:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847424:0@lo:104: 00010000:00010000:2.0:1787387985.479847:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387985.479857:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.479873:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbe00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387985.479878:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.479887:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387985.479894:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387985.479899:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387985.479948:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.479954:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387985.479981:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.479988:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafbe00/0x5cb77467b1811a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.480001:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387985.480002:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387985.480004:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387985.480013:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387985.480026:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971848576:0@lo:103: 00000100:00100000:2.0:1787387985.480056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.480083:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848576 00000100:00100000:2.0:1787387985.480088:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848576 00010000:00010000:2.0:1787387985.480118:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 24 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387985.480141:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387985.480149:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971848576:12345-0@lo:103: 00010000:00010000:2.0:1787387985.480160:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387985.480164:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 24 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.480173:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 24 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.480468:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b4000/0x5cb77467b1811a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811a59 expref: 24 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.480486:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387985.480523:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3646:x1874211971848576:12345-0@lo:103: Request processed in 375us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.480531:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387985.480589:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971848576:0@lo:103: 00000100:00100000:2.0:1787387985.480622:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787387985.480638:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.480650:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.480660:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.480669:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.480712:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.480730:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971847552 00000100:00100000:2.0:1787387985.480735:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971847552 00000100:00100000:2.0:1787387985.480755:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971847680 00000100:00100000:2.0:1787387985.480757:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971847680 00000100:00100000:2.0:1787387985.480776:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971847808 00000100:00100000:2.0:1787387985.480779:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971847808 00000100:00100000:2.0:1787387985.480788:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971847936 00000100:00100000:2.0:1787387985.480790:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971847936 00000100:00100000:2.0:1787387985.480797:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848064 00000100:00100000:2.0:1787387985.480799:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848064 00000100:00100000:2.0:1787387985.480808:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848192 00000100:00100000:2.0:1787387985.480810:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848192 00000100:00100000:2.0:1787387985.480819:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848320 00000100:00100000:2.0:1787387985.480821:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848320 00000100:00100000:2.0:1787387985.480829:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848448 00000100:00100000:2.0:1787387985.480831:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848448 00000100:00100000:2.0:1787387985.480843:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387985.480849:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:10334:x1874211971847552:12345-0@lo:104: 00010000:00010000:2.0:1787387985.480860:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.480898:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387985.480903:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+10:10334:x1874211971847552:12345-0@lo:104: Request processed in 55us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.480909:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387985.480922:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387985.480927:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:10334:x1874211971847680:12345-0@lo:104: 00010000:00010000:2.0:1787387985.480934:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481086:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387985.481091:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+9:10334:x1874211971847680:12345-0@lo:104: Request processed in 165us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481097:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387985.481118:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387985.481124:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+8:10334:x1874211971847808:12345-0@lo:104: 00010000:00010000:2.0:1787387985.481132:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481165:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787387985.481169:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+8:10334:x1874211971847808:12345-0@lo:104: Request processed in 46us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481174:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387985.481342:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387985.481349:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:10334:x1874211971847936:12345-0@lo:104: 00010000:00010000:2.0:1787387985.481356:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481458:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787387985.481462:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+7:10334:x1874211971847936:12345-0@lo:104: Request processed in 115us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481468:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387985.481480:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787387985.481486:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:10334:x1874211971848064:12345-0@lo:104: 00010000:00010000:2.0:1787387985.481493:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481518:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787387985.481532:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:10334:x1874211971848064:12345-0@lo:104: Request processed in 38us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481538:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787387985.481558:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387985.481564:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:10334:x1874211971848192:12345-0@lo:104: 00010000:00010000:2.0:1787387985.481572:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481600:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787387985.481605:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:10334:x1874211971848192:12345-0@lo:104: Request processed in 41us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481611:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387985.481623:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387985.481628:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:10334:x1874211971848320:12345-0@lo:104: 00010000:00010000:2.0:1787387985.481635:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481660:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787387985.481665:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:10334:x1874211971848320:12345-0@lo:104: Request processed in 37us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481671:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387985.481705:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387985.481711:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:10334:x1874211971848448:12345-0@lo:104: 00010000:00010000:2.0:1787387985.481729:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481766:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1787387985.481772:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:10334:x1874211971848448:12345-0@lo:104: Request processed in 62us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.481778:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787387985.481804:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1787387985.481809:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481815:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafae00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387985.481819:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481827:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387985.481834:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387985.481839:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387985.481864:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481870:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387985.481889:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481895:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafae00/0x5cb77467b1811a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481907:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787387985.481910:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481915:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387985.481917:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.481930:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387985.481937:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387985.481955:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387985.482086:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787387985.482092:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.482294:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847552:0@lo:104: 00000100:00100000:1.0:1787387985.482313:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847680:0@lo:104: 00000100:00100000:1.0:1787387985.482321:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847808:0@lo:104: 00000100:00100000:1.0:1787387985.482328:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847936:0@lo:104: 00000100:00100000:1.0:1787387985.482335:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848064:0@lo:104: 00000100:00100000:1.0:1787387985.482342:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848192:0@lo:104: 00000100:00100000:1.0:1787387985.482348:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848320:0@lo:104: 00000100:00100000:1.0:1787387985.482355:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971848448:0@lo:104: 00000100:00100000:3.0:1787387985.482833:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387985.482849:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971848704:0@lo:103: 00000100:00100000:3.0:1787387985.482903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387985.483106:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848704 00000100:00100000:1.0:1787387985.483115:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848704 00010000:00010000:1.0:1787387985.483144:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.483175:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387985.483183:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3645:x1874211971848704:12345-0@lo:103: 00010000:00010000:1.0:1787387985.483207:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387985.483212:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.483230:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.483248:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b4400/0x5cb77467b1811a36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811a2f expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.483264:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387985.483296:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3645:x1874211971848704:12345-0@lo:103: Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387985.483315:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787387985.483774:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:3.0:1787387985.484177:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971848704:0@lo:103: 00010000:00010000:3.0:1787387985.484657:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787387985.484667:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.484838:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847168:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787387985.484848:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874211971847296:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787387985.484888:0:10334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485129:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152be00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387985.485146:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485158:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387985.485166:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387985.485172:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387985.485230:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485237:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387985.485253:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485261:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152be00/0x5cb77467b18119e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485278:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787387985.485281:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485288:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387985.485291:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485298:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387985.485315:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387985.485320:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387985.485334:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485340:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387985.485356:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485498:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ff600/0x5cb77467b18119b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485509:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387985.485512:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485519:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387985.485532:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485540:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387985.485547:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387985.485552:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387985.485572:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485579:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387985.485584:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485591:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b4800/0x5cb77467b1811972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811979 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485600:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387985.485604:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485609:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787387985.485612:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485619:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387985.485624:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387985.485630:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387985.485640:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485646:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387985.485651:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485666:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ffc00/0x5cb77467b1811948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181194f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.485675:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387985.485699:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387985.485701:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387985.485716:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971848960:0@lo:103: 00000100:00100000:0.0:1787387985.485776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387985.485813:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387985.485820:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971849344:0@lo:103: 00000100:00100000:0.0:1787387985.485839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387985.485862:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849088:0@lo:103: 00000100:00100000:0.0:1787387985.485884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387985.485901:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387985.485906:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849216:0@lo:103: 00000100:00100000:0.0:1787387985.485923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387985.485967:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848960 00000100:00100000:0.0:1787387985.485973:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848960 00010000:00010000:0.0:1787387985.486000:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 22 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387985.486020:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849344 00000100:00100000:0.0:1787387985.486022:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849344 00010000:00010000:0.0:1787387985.486033:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387985.486043:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849088 00000100:00100000:0.0:1787387985.486051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849088 00010000:00010000:0.0:1787387985.486065:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 24 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387985.486075:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849216 00000100:00100000:0.0:1787387985.486077:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849216 00010000:00010000:0.0:1787387985.486087:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811972 expref: 25 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387985.486099:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387985.486107:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+25:3645:x1874211971848960:12345-0@lo:103: 00010000:00010000:0.0:1787387985.486121:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387985.486126:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 25 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486136:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 25 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486151:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe800/0x5cb77467b18119f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18119e9 expref: 25 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486167:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387985.486202:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3645:x1874211971848960:12345-0@lo:103: Request processed in 94us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387985.486210:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387985.486237:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787387985.486244:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3645:x1874211971849344:12345-0@lo:103: 00010000:00010000:0.0:1787387985.486251:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387985.486255:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486273:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486283:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafb400/0x5cb77467b181194f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811948 expref: 23 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486293:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387985.486315:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3645:x1874211971849344:12345-0@lo:103: Request processed in 73us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387985.486321:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787387985.486334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787387985.486340:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3646:x1874211971849088:12345-0@lo:103: 00010000:00010000:0.0:1787387985.486346:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387985.486350:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 21 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486357:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 21 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486656:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafbc00/0x5cb77467b18119b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18119b1 expref: 21 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486666:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387985.486741:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3646:x1874211971849088:12345-0@lo:103: Request processed in 401us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387985.486748:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787387985.486763:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387985.486769:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3646:x1874211971849216:12345-0@lo:103: 00010000:00010000:0.0:1787387985.486804:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387985.486809:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811972 expref: 19 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486817:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811972 expref: 19 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486825:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811972 expref: 19 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.486835:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387985.486860:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:3646:x1874211971849216:12345-0@lo:103: Request processed in 92us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387985.486866:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387985.486908:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971849344:0@lo:103: 00000100:00100000:0.0:1787387985.486918:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971848960:0@lo:103: 00000100:00100000:0.0:1787387985.486947:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849216:0@lo:103: 00000100:00100000:0.0:1787387985.486954:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849088:0@lo:103: 00010000:00010000:2.0:1787387985.487578:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.487587:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387985.487612:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.487618:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811a1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.487632:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387985.487633:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387985.487635:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387985.487643:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387985.487655:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971848832:0@lo:103: 00000100:00100000:2.0:1787387985.487715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387985.487768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971848832 00000100:00100000:2.0:1787387985.487774:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971848832 00010000:00010000:2.0:1787387985.487800:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 18 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387985.487822:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387985.487830:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:3644:x1874211971848832:12345-0@lo:103: 00010000:00010000:2.0:1787387985.487848:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387985.487853:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 18 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.487862:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 18 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.487875:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b4200/0x5cb77467b1811a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811a13 expref: 18 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387985.487884:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387985.487913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:3644:x1874211971848832:12345-0@lo:103: Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387985.487919:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387985.487970:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971848832:0@lo:103: 00010000:00010000:3.0:1787387985.488510:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:3.0:1787387985.488517:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.488528:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387985.488535:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387985.488541:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387985.488608:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.488627:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387985.488657:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.488664:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5a00/0x5cb77467b18119cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.488673:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387985.488674:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387985.488693:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387985.488780:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849472:0@lo:103: 00000100:00100000:0.0:1787387985.488819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387985.488859:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849472 00000100:00100000:0.0:1787387985.488864:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849472 00010000:00010000:0.0:1787387985.488884:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119cd expref: 17 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387985.488906:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387985.488913:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:3646:x1874211971849472:12345-0@lo:103: 00010000:00010000:0.0:1787387985.488929:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387985.488934:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119cd expref: 17 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.488957:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18119cd expref: 17 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.488976:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafa600/0x5cb77467b18119d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18119cd expref: 17 pid: 6514 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.488986:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387985.489016:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:3646:x1874211971849472:12345-0@lo:103: Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387985.489023:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387985.489083:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849472:0@lo:103: 00010000:00010000:0.0:1787387985.490171:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387985.490175:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387985.490177:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387985.490315:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490327:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5c00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:3.0:1787387985.490330:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490339:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387985.490346:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387985.490352:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387985.490468:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490475:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387985.490502:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490520:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5c00/0x5cb77467b18119bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18119c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387985.490557:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387985.490573:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849600:0@lo:103: 00000100:00100000:3.0:1787387985.490629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387985.490675:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849600 00000100:00100000:3.0:1787387985.490706:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849600 00010000:00010000:3.0:1787387985.490739:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119bf expref: 16 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387985.490766:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787387985.490775:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:3646:x1874211971849600:12345-0@lo:103: 00010000:00010000:3.0:1787387985.490786:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387985.490791:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18119bf expref: 16 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490799:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18119bf expref: 16 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490812:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a600/0x5cb77467b18119c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18119bf expref: 16 pid: 6513 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387985.490823:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387985.491472:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3646:x1874211971849600:12345-0@lo:103: Request processed in 696us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387985.491481:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787387985.491531:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849600:0@lo:103: 00010000:00010000:3.0:1787387985.491566:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387985.491568:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387985.491570:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387985.494603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387985.494782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387985.495956:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923264 00000100:00100000:1.0:1787387985.496157:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923264 00010000:00010000:1.0:1787387985.496212:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 10 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.496255:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923392 00000100:00100000:1.0:1787387985.496259:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923392 00010000:00010000:1.0:1787387985.496272:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387985.496300:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:1.0:1787387985.496309:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2404:x1874211952923264:12345-192.168.204.52@tcp:103: 00010000:00010000:1.0:1787387985.496324:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387985.496330:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.496342:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387985.496505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 34 00000100:00100000:0.0:1787387985.496516:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2403:x1874211952923392:12345-192.168.204.52@tcp:103: 00010000:00010000:0.0:1787387985.496525:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387985.496530:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496540:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496568:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b2a expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496583:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496591:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496606:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496613:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496619:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496626:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496632:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787387985.496637:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496645:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496661:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387985.496709:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387985.496775:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952923392:12345-192.168.204.52@tcp:103: Request processed in 261us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387985.496783:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 34 00010000:00010000:1.0:1787387985.497108:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fea00/0x5cb77467b1811a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b31 expref: 11 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.497132:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387985.497167:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:2404:x1874211952923264:12345-192.168.204.52@tcp:103: Request processed in 859us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387985.497174:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 33 00010000:00010000:1.0:1787387985.497201:0:10334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.497209:0:10334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387985.497215:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafb200/0x5cb77467b1811ab4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387986.055995:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387986.442766:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971850112:0@lo:400: 00000100:00100000:3.0:1787387986.442799:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971849856:0@lo:13: 00000100:00100000:2.0:1787387986.442900:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971849728:0@lo:13: 00000100:00100000:0.0:1787387986.442951:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849984:0@lo:400: 00000100:00100000:3.0:1787387986.451494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.451575:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971850368:0@lo:400: 00000100:00100000:3.0:1787387986.451624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.451645:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971850880:0@lo:400: 00000100:00100000:3.0:1787387986.451667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.451713:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971851392:0@lo:400: 00000100:00100000:3.0:1787387986.451739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.451841:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849856 00000100:00100000:3.0:1787387986.451852:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849856 00000100:00100000:3.0:1787387986.451925:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387986.451937:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971849856:12345-0@lo:13: 00002000:00000024:3.0:1787387986.451969:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387986.452018:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971849856:12345-0@lo:13: Request processed in 84us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.452026:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387986.452049:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850368 00000100:00100000:3.0:1787387986.452053:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850368 00000100:00100000:3.0:1787387986.452078:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850880 00000100:00100000:3.0:1787387986.452081:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850880 00000100:00100000:3.0:1787387986.452106:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387986.452113:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971850368:12345-0@lo:400: 00000100:00100000:3.0:1787387986.452145:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971850368:12345-0@lo:400: Request processed in 33us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.452172:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387986.452186:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387986.452192:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971850880:12345-0@lo:400: 00000100:00100000:3.0:1787387986.452223:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971850880:12345-0@lo:400: Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.452229:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787387986.452247:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387986.452253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787387986.452281:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3618000 x1874211971849856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387986.452302:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971849856:0@lo:13: 00000100:00100000:3.0:1787387986.452315:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971850368:0@lo:400: 00000100:00100000:3.0:1787387986.452324:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971850880:0@lo:400: 00000100:00100000:3.0:1787387986.452373:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851392 00000100:00100000:3.0:1787387986.452378:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851392 00000100:00100000:3.0:1787387986.452402:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387986.452409:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971851392:12345-0@lo:400: 00000100:00100000:3.0:1787387986.452442:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971851392:12345-0@lo:400: Request processed in 34us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.452448:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787387986.452471:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f2300 x1874211971851392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387986.452480:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971851392:0@lo:400: 00000100:00100000:2.0:1787387986.460048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387986.460132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971850240:0@lo:400: 00000100:00100000:2.0:1787387986.460187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387986.460217:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971850752:0@lo:400: 00000100:00100000:2.0:1787387986.460252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387986.460272:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971851264:0@lo:400: 00000100:00100000:2.0:1787387986.460296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387986.460345:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850752 00000100:00100000:2.0:1787387986.460352:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850752 00000100:00100000:2.0:1787387986.460419:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387986.460429:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971850752:12345-0@lo:400: 00000100:00100000:2.0:1787387986.460512:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971850752:12345-0@lo:400: Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.460519:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787387986.460539:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387986.460550:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851264 00000100:00100000:2.0:1787387986.460554:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851264 00000100:00100000:2.0:1787387986.460579:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787387986.460585:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971851264:12345-0@lo:400: 00000100:00100000:2.0:1787387986.460612:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971851264:12345-0@lo:400: Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.460618:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787387986.460632:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787387986.460655:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f3b80 x1874211971850752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387986.460668:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971850752:0@lo:400: 00010000:00080000:2.0:1787387986.460696:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f1880 x1874211971851264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387986.460715:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971851264:0@lo:400: 00000100:00100000:2.0:1787387986.460766:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850240 00000100:00100000:2.0:1787387986.460770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850240 00000100:00100000:2.0:1787387986.460797:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787387986.460803:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971850240:12345-0@lo:400: 00000100:00100000:2.0:1787387986.460839:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971850240:12345-0@lo:400: Request processed in 36us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.460845:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787387986.460869:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971850240:0@lo:400: 00000100:00100000:0.0:1787387986.461638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387986.461694:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971850496:0@lo:400: 00000100:00100000:0.0:1787387986.461737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387986.461764:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850496 00000100:00100000:0.0:1787387986.461769:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850496 00000100:00100000:0.0:1787387986.461798:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787387986.461804:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971850496:12345-0@lo:400: 00000100:00100000:0.0:1787387986.461837:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971850496:12345-0@lo:400: Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387986.461844:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787387986.461871:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971850496:0@lo:400: 00000100:00100000:0.0:1787387986.461878:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971851008:0@lo:400: 00000100:00100000:0.0:1787387986.461900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387986.461917:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971851520:0@lo:400: 00000100:00100000:0.0:1787387986.461938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387986.461964:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387986.461970:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971851648:0@lo:41: 00000100:00100000:0.0:1787387986.461990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.462331:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849728 00000100:00100000:3.0:1787387986.462343:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849728 00000100:00100000:3.0:1787387986.462401:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387986.462408:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971849728:12345-0@lo:13: 00002000:00000024:3.0:1787387986.462424:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387986.462465:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971849728:12345-0@lo:13: Request processed in 57us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.462471:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387986.462490:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851008 00000100:00100000:3.0:1787387986.462493:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851008 00000100:00100000:3.0:1787387986.462521:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787387986.462528:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971851008:12345-0@lo:400: 00000100:00100000:3.0:1787387986.462562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971851008:12345-0@lo:400: Request processed in 35us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.462568:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787387986.462589:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851520 00000100:00100000:3.0:1787387986.462593:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851520 00000100:00100000:3.0:1787387986.462612:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387986.462618:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971851520:12345-0@lo:400: 00000100:00100000:3.0:1787387986.462647:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971851520:12345-0@lo:400: Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.462653:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787387986.463828:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787387986.463839:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387986.463885:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f1f80 x1874211971851008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387986.463900:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971851008:0@lo:400: 00010000:00080000:0.0:1787387986.463914:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f2a00 x1874211971851520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387986.463922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971851520:0@lo:400: 00000100:00100000:2.0:1787387986.463939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971849984 00000100:00100000:2.0:1787387986.463945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971849984 00000100:00100000:0.0:1787387986.463972:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851648 00000100:00100000:0.0:1787387986.463975:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851648 00000100:00100000:0.0:1787387986.464008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387986.464009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787387986.464016:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971851648:12345-0@lo:41: 00000100:00100000:2.0:1787387986.464017:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3646:x1874211971849984:12345-0@lo:400: 00000004:00000024:0.0:1787387986.464045:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787387986.464082:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:3646:x1874211971849984:12345-0@lo:400: Request processed in 67us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.464090:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:3.0:1787387986.464141:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f0380 x1874211971849728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387986.464156:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971849728:0@lo:13: 00000100:00100000:1.0:1787387986.468638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387986.468806:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971850624:0@lo:400: 00000100:00100000:1.0:1787387986.468883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387986.468914:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971851136:0@lo:400: 00000100:00100000:1.0:1787387986.468941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.469136:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850624 00000100:00100000:3.0:1787387986.469146:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850624 00000100:00100000:3.0:1787387986.469229:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387986.469253:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971850624:12345-0@lo:400: 00000100:00100000:3.0:1787387986.469309:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971850624:12345-0@lo:400: Request processed in 58us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.469315:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787387986.469336:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387986.470140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971851648:12345-0@lo:41: Request processed in 6120us (8144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387986.470153:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787387986.470239:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971851648:0@lo:41: 00000100:00100000:0.0:1787387986.470255:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971849984:0@lo:400: 00010000:00080000:1.0:1787387986.475195:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f3100 x1874211971850624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387986.475214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971850624:0@lo:400: 00000100:00100000:2.0:1787387986.477409:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971850112 00000100:00100000:2.0:1787387986.477425:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971850112 00000100:00100000:2.0:1787387986.478368:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851136 00000100:00100000:2.0:1787387986.478376:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851136 00000100:00100000:2.0:1787387986.478485:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787387986.478495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971850112:12345-0@lo:400: 00000100:00100000:2.0:1787387986.478594:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971850112:12345-0@lo:400: Request processed in 100us (9965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.478602:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787387986.478621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387986.478628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971851136:12345-0@lo:400: 00000100:00100000:2.0:1787387986.478658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971851136:12345-0@lo:400: Request processed in 31us (9717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.478664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787387986.479473:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971850112:0@lo:400: 00000100:00100000:0.0:1787387986.479492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971851136:0@lo:400: 00000100:00080000:1.0:1787387986.482308:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787387987.080543:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787387987.143860:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387987.143872:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff927401ba8000 from 48 10000000:01000000:1.0:1787387987.143878:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387987.143964:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.143977:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.143990:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387987.144016:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971851776:0@lo:101: 00000100:00100000:1.0:1787387987.144095:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.144175:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.144378:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851776 00000100:00100000:3.0:1787387987.144387:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851776 00000100:00100000:3.0:1787387987.144560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787387987.144571:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+15:6517:x1874211971851776:12345-0@lo:101: 00010000:00010000:3.0:1787387987.144587:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387987.144602:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152a600/0x5cb77467b1811ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811abb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.144629:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a600/0x5cb77467b1811ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811abb expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.144639:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152a600/0x5cb77467b1811ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811abb expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.144648:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152a600, rc 0) 00000100:00100000:3.0:1787387987.144753:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971851776:12345-0@lo:101: Request processed in 183us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.144760:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787387987.144843:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971851776:0@lo:101: 00010000:00010000:0.0:1787387987.144859:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.144869:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387987.144960:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971851904:0@lo:501: 00000100:00100000:0.0:1787387987.144985:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.151785:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d06033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.157020:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971851904 00000100:00100000:1.0:1787387987.157036:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971851904 00000100:00100000:1.0:1787387987.157102:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787387987.157112:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971851904:12345-0@lo:501: 00000100:00100000:1.0:1787387987.157751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971851904:12345-0@lo:501: Request processed in 637us (12761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.157761:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787387987.158021:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971851904:0@lo:501: 00000100:00100000:0.0:1787387987.158072:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852032:0@lo:503: 00000100:00100000:0.0:1787387987.158127:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.158215:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d06033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.158311:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852032 00000100:00100000:1.0:1787387987.158317:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852032 00000100:00100000:1.0:1787387987.158342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787387987.158349:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971852032:12345-0@lo:503: 00000100:00100000:1.0:1787387987.158792:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971852032:12345-0@lo:503: Request processed in 440us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.158800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787387987.164150:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852032:0@lo:503: 00000100:00100000:3.0:1787387987.165934:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10353:1874211971852160:0@lo:502: 00000100:00100000:3.0:1787387987.166024:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.166106:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.166147:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852160 00000100:00100000:1.0:1787387987.166155:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852160 00000100:00100000:1.0:1787387987.166236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787387987.166263:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:10353:x1874211971852160:12345-0@lo:502: 00000100:00100000:1.0:1787387987.166720:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:10353:x1874211971852160:12345-0@lo:502: Request processed in 456us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.166728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787387987.166819:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10353:1874211971852160:0@lo:502: 00000100:00100000:0.0:1787387987.166871:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10353:1874211971852288:0@lo:502: 00000100:00100000:0.0:1787387987.166911:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.167118:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d06033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.167153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852288 00000100:00100000:3.0:1787387987.167158:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852288 00000100:00100000:3.0:1787387987.167185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787387987.167197:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:10353:x1874211971852288:12345-0@lo:502: 00000100:00100000:3.0:1787387987.167891:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:10353:x1874211971852288:12345-0@lo:502: Request processed in 690us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.167900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787387987.167991:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10353:1874211971852288:0@lo:502: 00000040:00080000:0.0:1787387987.168021:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787387987.168827:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787387987.168857:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387987.168870:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.168882:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387987.169773:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787387987.169781:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787387987.169785:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787387987.169830:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.169841:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.169851:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.169875:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852416:0@lo:101: 00000100:00100000:2.0:1787387987.170291:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.170453:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387987.173903:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852416 00000100:00100000:0.0:1787387987.173934:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852416 00000100:00100000:0.0:1787387987.174015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787387987.174026:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+16:6517:x1874211971852416:12345-0@lo:101: 00010000:00010000:0.0:1787387987.174045:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387987.174064:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafaa00/0x5cb77467b1811ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811ac9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.174095:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafaa00/0x5cb77467b1811ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811ac9 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.174132:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafaa00/0x5cb77467b1811ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811ac9 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.174142:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafaa00, rc 0) 00000100:00100000:0.0:1787387987.174246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971852416:12345-0@lo:101: Request processed in 221us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.174253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787387987.175399:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852416:0@lo:101: 00010000:00010000:1.0:1787387987.175425:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.175436:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387987.175588:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852544:0@lo:501: 00000100:00100000:1.0:1787387987.175639:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.175790:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787387987.176255:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852544 00000100:00100000:0.0:1787387987.176262:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852544 00000100:00100000:0.0:1787387987.176428:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787387987.176440:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971852544:12345-0@lo:501: 00000100:00100000:0.0:1787387987.176612:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971852544:12345-0@lo:501: Request processed in 174us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.176621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787387987.176729:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852544:0@lo:501: 00000100:00100000:1.0:1787387987.176767:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852672:0@lo:503: 00000100:00100000:1.0:1787387987.176822:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.190423:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.199868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852672 00000100:00100000:2.0:1787387987.199889:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852672 00000100:00100000:2.0:1787387987.199996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787387987.200008:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971852672:12345-0@lo:503: 00000100:00100000:2.0:1787387987.201039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971852672:12345-0@lo:503: Request processed in 1028us (24211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.201050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787387987.201458:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971852672:0@lo:503: 00000100:00100000:3.0:1787387987.202252:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10354:1874211971852800:0@lo:502: 00000100:00100000:3.0:1787387987.202315:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.202357:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.202908:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852800 00000100:00100000:2.0:1787387987.202920:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852800 00000100:00100000:2.0:1787387987.202976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787387987.202985:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:10354:x1874211971852800:12345-0@lo:502: 00000100:00100000:2.0:1787387987.203135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:10354:x1874211971852800:12345-0@lo:502: Request processed in 151us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.203149:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787387987.203610:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10354:1874211971852800:0@lo:502: 00000020:01000000:3.0:1787387987.203644:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387987.203654:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387987.203657:0:10354:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787387987.203661:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787387987.203732:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10354:1874211971852928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.203777:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.203812:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.204024:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971852928 00000100:00100000:2.0:1787387987.204030:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971852928 00000100:00100000:2.0:1787387987.204069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787387987.204077:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:10354:x1874211971852928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.205100:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:10354:x1874211971852928:12345-0@lo:502:llog_process_th.0 Request processed in 237us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.205123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787387987.205834:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10354:1874211971852928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387987.205870:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387987.205877:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387987.205880:0:10354:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387987.205884:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1787387987.206132:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787387987.206256:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787387987.206268:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.206280:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387987.206305:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387987.206308:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eef18800 from 48 10000000:01000000:1.0:1787387987.206310:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387987.206399:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.206408:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.206417:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387987.206435:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.206560:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.206593:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387987.207513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853056 00000100:00100000:0.0:1787387987.207525:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853056 00000100:00100000:0.0:1787387987.207599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787387987.207609:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+17:6517:x1874211971853056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387987.207624:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387987.207638:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafa000/0x5cb77467b1811ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811ad7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.207663:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafa000/0x5cb77467b1811ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811ad7 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.207674:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafa000/0x5cb77467b1811ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811ad7 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.207728:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa000, rc 0) 00000100:00100000:0.0:1787387987.207780:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971853056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.207786:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787387987.208806:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387987.208831:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.208841:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387987.209007:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.209059:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.209240:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.209307:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853184 00000100:00100000:2.0:1787387987.209315:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853184 00000100:00100000:2.0:1787387987.209371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787387987.209381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971853184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.209541:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971853184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.209548:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787387987.210287:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.210351:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.210414:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.210449:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.212273:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853312 00000100:00100000:2.0:1787387987.212289:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853312 00000100:00100000:2.0:1787387987.212364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787387987.212375:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971853312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.212779:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971853312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 405us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.212786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787387987.213388:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.215887:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10355:1874211971853440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387987.216274:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.216384:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387987.218782:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853440 00000100:00100000:0.0:1787387987.218802:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853440 00000100:00100000:1.0:1787387987.219161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787387987.219173:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:10355:x1874211971853440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387987.219364:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:10355:x1874211971853440:12345-0@lo:502:llog_process_th.0 Request processed in 193us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.219372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787387987.219480:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10355:1874211971853440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.219548:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10355:1874211971853568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.219594:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.225928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853568 00000100:00100000:2.0:1787387987.225948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853568 00000100:00100000:2.0:1787387987.226154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787387987.226166:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:10355:x1874211971853568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.226384:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:10355:x1874211971853568:12345-0@lo:502:llog_process_th.0 Request processed in 219us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.226392:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787387987.226522:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17480 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.226551:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10355:1874211971853568:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787387987.227115:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787387987.227461:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787387987.227483:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387987.227493:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.227505:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387987.227516:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787387987.227518:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787387987.227521:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387987.227556:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.227564:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.227574:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.227911:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.227968:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.228027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853696 00000100:00100000:0.0:1787387987.228035:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853696 00000100:00100000:0.0:1787387987.228083:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787387987.228092:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+18:6517:x1874211971853696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387987.228102:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387987.228125:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafb000/0x5cb77467b1811aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811ae5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.228263:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b000 going to sleep for 11 seconds 00010000:00010000:0.0:1787387987.228275:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafb000/0x5cb77467b1811aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811ae5 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.228290:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafb000/0x5cb77467b1811aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811ae5 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.228300:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb000, rc 0) 00000100:00100000:0.0:1787387987.228353:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971853696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.228359:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787387987.228450:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387987.228639:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.228666:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.228766:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.228796:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.228878:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.233393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853824 00000100:00100000:1.0:1787387987.233408:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853824 00000100:00100000:0.0:1787387987.233834:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787387987.233846:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971853824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.234053:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971853824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (5254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.234078:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787387987.234191:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.234251:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.234305:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.242385:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.242453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971853952 00000100:00100000:2.0:1787387987.243086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971853952 00000100:00100000:2.0:1787387987.243153:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787387987.243163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971853952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.243398:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971853952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (9091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.243407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787387987.243543:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971853952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.244187:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10356:1874211971854080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.244242:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.244307:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.244349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854080 00000100:00100000:3.0:1787387987.244357:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854080 00000100:00100000:3.0:1787387987.244384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787387987.244391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:10356:x1874211971854080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.244546:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:10356:x1874211971854080:12345-0@lo:502:llog_process_th.0 Request processed in 154us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.244554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787387987.244661:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10356:1874211971854080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387987.244996:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387987.245006:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387987.245009:0:10356:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787387987.245015:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787387987.245041:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10356:1874211971854208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.245081:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.245150:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.245183:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854208 00000100:00100000:2.0:1787387987.245188:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854208 00000100:00100000:2.0:1787387987.245213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787387987.245221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:10356:x1874211971854208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.245346:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:10356:x1874211971854208:12345-0@lo:502:llog_process_th.0 Request processed in 125us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.245353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787387987.245424:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10356:1874211971854208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387987.245444:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387987.245449:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387987.245451:0:10356:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387987.245454:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787387987.245878:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787387987.245902:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787387987.245913:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.245924:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387987.245935:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387987.245938:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273eedc0000 from 48 10000000:01000000:2.0:1787387987.245941:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387987.245971:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.245980:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.245991:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.246009:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.246045:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.246104:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.246139:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854336 00000100:00100000:3.0:1787387987.246144:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854336 00000100:00100000:3.0:1787387987.246168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787387987.246174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:6517:x1874211971854336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387987.246184:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387987.246201:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152a400/0x5cb77467b1811afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811af3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.246222:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152a400/0x5cb77467b1811afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811af3 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.246233:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152a400/0x5cb77467b1811afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811af3 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.246242:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152a400, rc 0) 00000100:00100000:3.0:1787387987.246316:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971854336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.246322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787387987.246377:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387987.246389:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.246398:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.246461:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.246497:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.246552:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.246588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854464 00000100:00100000:3.0:1787387987.246592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854464 00000100:00100000:3.0:1787387987.246881:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787387987.246890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971854464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.247051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971854464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.247058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787387987.247106:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.247135:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.247173:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.247232:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.247267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854592 00000100:00100000:3.0:1787387987.247271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854592 00000100:00100000:3.0:1787387987.247290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787387987.247295:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971854592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.247409:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971854592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.247416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787387987.247473:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.248023:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10357:1874211971854720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.248069:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.248135:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.248169:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854720 00000100:00100000:2.0:1787387987.248174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854720 00000100:00100000:2.0:1787387987.248197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787387987.248203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:10357:x1874211971854720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.248333:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:10357:x1874211971854720:12345-0@lo:502:llog_process_th.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.248340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787387987.248407:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10357:1874211971854720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.248445:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10357:1874211971854848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.248478:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.248531:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.248556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854848 00000100:00100000:2.0:1787387987.248561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854848 00000100:00100000:2.0:1787387987.248580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787387987.248585:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:10357:x1874211971854848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.249046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:10357:x1874211971854848:12345-0@lo:502:llog_process_th.0 Request processed in 459us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.249053:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787387987.249111:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10357:1874211971854848:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787387987.249132:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787387987.249288:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787387987.249317:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387987.249325:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.249335:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387987.249344:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787387987.249347:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787387987.249349:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787387987.249374:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.249382:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.249392:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387987.249417:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.249446:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387987.249476:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.249489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971854976 00000100:00100000:3.0:1787387987.249492:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971854976 00000100:00100000:3.0:1787387987.249526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787387987.249534:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971854976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387987.249541:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387987.249552:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c152be00/0x5cb77467b1811b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b01 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.249572:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c152be00/0x5cb77467b1811b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b01 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.249584:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c152be00/0x5cb77467b1811b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b01 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.249592:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152be00, rc 0) 00000100:00100000:3.0:1787387987.251848:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971854976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2305us (2391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.251860:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787387987.252056:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971854976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387987.252078:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.252089:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387987.252175:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.252229:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.252269:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.252387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855104 00000100:00100000:1.0:1787387987.252394:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855104 00000100:00100000:1.0:1787387987.252441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787387987.252450:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971855104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.252586:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971855104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.252594:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787387987.252717:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.252747:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.252788:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.252914:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.253036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855232 00000100:00100000:1.0:1787387987.253041:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855232 00000100:00100000:1.0:1787387987.253071:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787387987.253078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971855232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.253209:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971855232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.253216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787387987.253321:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.253870:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10358:1874211971855360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387987.253911:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.253971:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.254009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855360 00000100:00100000:2.0:1787387987.254014:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855360 00000100:00100000:2.0:1787387987.254043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787387987.254050:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10358:x1874211971855360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.254250:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10358:x1874211971855360:12345-0@lo:502:llog_process_th.0 Request processed in 198us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.254257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787387987.254316:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10358:1874211971855360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787387987.254339:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387987.254347:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387987.254350:0:10358:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787387987.254355:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787387987.254375:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10358:1874211971855488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387987.254405:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.254438:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387987.254449:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855488 00000100:00100000:0.0:1787387987.254454:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855488 00000100:00100000:3.0:1787387987.254577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787387987.254587:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10358:x1874211971855488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.254871:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10358:x1874211971855488:12345-0@lo:502:llog_process_th.0 Request processed in 286us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.254878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787387987.254938:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10358:1874211971855488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787387987.254957:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387987.254962:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387987.254964:0:10358:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787387987.254967:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1787387987.255102:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1787387987.255125:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787387987.255135:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.255145:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387987.255166:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787387987.255175:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273c9714000 from 48 10000000:01000000:0.0:1787387987.255179:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387987.255212:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.255221:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.255231:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387987.255245:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.255275:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.255308:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.255348:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855616 00000100:00100000:1.0:1787387987.255353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855616 00000100:00100000:3.0:1787387987.255420:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787387987.255429:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971855616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387987.255437:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387987.255449:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1482400/0x5cb77467b1811b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.255479:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1482400/0x5cb77467b1811b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b0f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.255489:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1482400/0x5cb77467b1811b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b0f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.255499:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1482400, rc 0) 00000100:00100000:3.0:1787387987.255535:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971855616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.255541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787387987.255594:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387987.255607:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387987.255620:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387987.255668:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.255733:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.255747:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387987.255851:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855744 00000100:00100000:2.0:1787387987.255859:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855744 00000100:00100000:2.0:1787387987.255893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787387987.255900:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971855744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.256008:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971855744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.256016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787387987.256089:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.256114:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387987.256150:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387987.256213:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.256265:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971855872 00000100:00100000:3.0:1787387987.256269:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971855872 00000100:00100000:3.0:1787387987.256299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787387987.256306:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971855872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.256377:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971855872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.256384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787387987.256547:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971855872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.257071:0:10359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10359:1874211971856000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.257108:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.257164:0:10359:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.257342:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856000 00000100:00100000:1.0:1787387987.257348:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856000 00000100:00100000:1.0:1787387987.257414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787387987.257429:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10359:x1874211971856000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387987.257523:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10359:x1874211971856000:12345-0@lo:502:llog_process_th.0 Request processed in 95us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.257531:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787387987.257598:0:10359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10359:1874211971856000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.257634:0:10359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10359:1874211971856128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.257660:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.257857:0:10359:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.258050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856128 00000100:00100000:3.0:1787387987.258054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856128 00000100:00100000:3.0:1787387987.258080:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787387987.258085:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10359:x1874211971856128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.258165:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10359:x1874211971856128:12345-0@lo:502:llog_process_th.0 Request processed in 79us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.258178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787387987.258263:0:10359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10359:1874211971856128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787387987.258284:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787387987.258430:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787387987.258450:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387987.258458:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.258469:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387987.258478:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787387987.258481:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787387987.258484:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387987.258511:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.258519:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.258529:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387987.258544:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.258588:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.258609:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.258645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856256 00000100:00100000:3.0:1787387987.258649:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856256 00000100:00100000:3.0:1787387987.258709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787387987.258717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971856256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387987.258726:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387987.258739:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1482e00/0x5cb77467b1811b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.258762:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1482e00/0x5cb77467b1811b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b1d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.258772:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1482e00/0x5cb77467b1811b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b1d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.258780:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1482e00, rc 0) 00000100:00100000:3.0:1787387987.258815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971856256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.258821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787387987.258924:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387987.258957:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.258966:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.259024:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.259051:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.259079:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.259204:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856384 00000100:00100000:3.0:1787387987.259208:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856384 00000100:00100000:3.0:1787387987.259237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787387987.259243:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971856384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.259343:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971856384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.259349:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787387987.259542:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.259569:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.259604:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.259625:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.259662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856512 00000100:00100000:3.0:1787387987.259672:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856512 00000100:00100000:3.0:1787387987.259733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787387987.259739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971856512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387987.259815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971856512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.259821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787387987.260105:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.260436:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10360:1874211971856640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.260476:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.260504:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.260542:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856640 00000100:00100000:3.0:1787387987.260547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856640 00000100:00100000:3.0:1787387987.260575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787387987.260582:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10360:x1874211971856640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.260713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10360:x1874211971856640:12345-0@lo:502:llog_process_th.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.260721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787387987.260836:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10360:1874211971856640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387987.260859:0:10360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387987.260869:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387987.260872:0:10360:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787387987.260878:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787387987.260898:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10360:1874211971856768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387987.260928:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.260959:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.261099:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856768 00000100:00100000:3.0:1787387987.261104:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856768 00000100:00100000:3.0:1787387987.261132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787387987.261139:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10360:x1874211971856768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387987.261209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10360:x1874211971856768:12345-0@lo:502:llog_process_th.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.261216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787387987.261301:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10360:1874211971856768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387987.261319:0:10360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387987.261324:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387987.261325:0:10360:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787387987.261329:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787387987.261463:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787387987.261481:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787387987.261497:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.261508:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387987.261517:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787387987.261519:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9273d0f44d40 from 1 10000000:01000000:1.0:1787387987.261522:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787387987.261544:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.261552:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387987.261562:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387987.261575:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.261603:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.261623:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387987.261663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971856896 00000100:00100000:3.0:1787387987.261667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971856896 00000100:00100000:3.0:1787387987.261809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787387987.261817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971856896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387987.261826:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387987.261837:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1483600/0x5cb77467b1811b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.261869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1483600/0x5cb77467b1811b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b2b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.261879:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1483600/0x5cb77467b1811b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b2b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387987.261889:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1483600, rc 0) 00000100:00100000:3.0:1787387987.261932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971856896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.261938:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787387987.263576:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971856896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387987.263600:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.263612:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387987.263716:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971857024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387987.263764:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387987.264173:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387987.264221:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857024 00000100:00100000:1.0:1787387987.264227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857024 00000100:00100000:1.0:1787387987.264262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787387987.264270:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971857024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387987.264403:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971857024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (638us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387987.264411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787387987.264626:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971857024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787387987.264661:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787387987.264668:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387987.264841:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387987.286364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387987.286513:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923648 00000100:00100000:2.0:1787387987.286524:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923648 00000100:00100000:2.0:1787387987.287166:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:2.0:1787387987.287179:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952923648:12345-192.168.204.52@tcp:400: 00000100:00100000:2.0:1787387987.287275:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952923648:12345-192.168.204.52@tcp:400: Request processed in 98us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387987.287284:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00080000:1.0:1787387987.289149:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387987.289504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387987.289581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923520 00000100:00100000:1.0:1787387987.289853:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923520 00000100:00100000:1.0:1787387987.289914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 242 00000100:00100000:1.0:1787387987.290060:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:2404:x1874211952923520:12345-192.168.204.52@tcp:400: 00000100:00100000:1.0:1787387987.290259:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:2404:x1874211952923520:12345-192.168.204.52@tcp:400: Request processed in 335us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.290267:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 242 00000100:00100000:0.0:1787387987.311935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387987.312012:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923776 00000100:00100000:0.0:1787387987.312015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387987.312024:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923776 00000100:00100000:0.0:1787387987.312055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387987.312085:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924032 00000100:00100000:0.0:1787387987.312089:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924032 00000100:00100000:3.0:1787387987.312091:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:3.0:1787387987.312100:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952923776:12345-192.168.204.52@tcp:400: 00000100:00100000:0.0:1787387987.312127:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952923904 00000100:00100000:0.0:1787387987.312130:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952923904 00000100:00100000:0.0:1787387987.312145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:0.0:1787387987.312151:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952924032:12345-192.168.204.52@tcp:400: 00000100:00100000:3.0:1787387987.312186:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952923776:12345-192.168.204.52@tcp:400: Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.312195:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:2.0:1787387987.312220:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787387987.312229:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1787387987.312299:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387987.312305:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387987.312307:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787387987.312330:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787387987.312341:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787387987.312348:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952923904:12345-192.168.204.52@tcp:400: 00000100:00100000:0.0:1787387987.319016:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952924032:12345-192.168.204.52@tcp:400: Request processed in 6773us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.319036:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787387987.319369:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952923904:12345-192.168.204.52@tcp:400: Request processed in 7018us (7309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.319379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00010000:00010000:3.0:1787387988.104328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387989.128776:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387989.511962:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387989.511989:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971857152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787387989.512064:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387989.512487:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857152 00000100:00100000:2.0:1787387989.512496:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857152 00000100:00100000:2.0:1787387989.512602:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387989.512615:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971857152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787387989.512660:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387989.512733:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971857152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387989.512741:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787387989.513995:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d92a00 x1874211971857152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387989.514019:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971857152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787387989.514235:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387989.514250:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971857280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387989.514303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387989.514509:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857280 00000100:00100000:0.0:1787387989.514516:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857280 00000100:00080000:1.0:1787387989.514581:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387989.516774:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787387989.516789:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971857280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387989.516831:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387989.516929:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971857280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387989.516937:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787387989.517520:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d59880 x1874211971857280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387989.517543:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971857280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387990.025747:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787387990.025824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387990.026819:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857408 00000100:00100000:3.0:1787387990.026851:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857408 00000100:00100000:3.0:1787387990.026913:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787387990.026926:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971857408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787387990.026968:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787387990.027183:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971857408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 259us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387990.027192:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787387990.027994:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971857408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787387990.152822:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387991.176270:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387991.560886:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971857536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787387991.560965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.561292:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971857664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787387991.561324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387991.561415:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857664 00000100:00100000:0.0:1787387991.561423:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857664 00000100:00100000:0.0:1787387991.561487:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787387991.561497:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971857664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787387991.561526:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387991.561568:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971857664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387991.561575:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787387991.561749:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5aa00 x1874211971857664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387991.561767:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971857664:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787387991.561789:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387991.561905:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857536 00000100:00100000:3.0:1787387991.561910:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857536 00000100:00100000:3.0:1787387991.561951:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787387991.561959:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971857536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787387991.561981:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787387991.562024:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971857536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.562030:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787387991.562138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971857536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787387991.562393:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971857792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387991.562439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387991.562558:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857792 00000100:00100000:1.0:1787387991.562563:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857792 00000100:00100000:1.0:1787387991.562628:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387991.562636:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971857792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387991.562651:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387991.562715:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971857792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387991.562722:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787387991.562752:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f3b80 x1874211971857792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787387991.562966:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387991.563057:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971857792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387991.565222:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971858176:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387991.565328:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971858688:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387991.565377:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387991.565384:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971858304:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387991.565426:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971858816:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387991.565473:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858176 00000100:00100000:3.0:1787387991.565496:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858176 00000100:00100000:3.0:1787387991.565541:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858688 00000100:00100000:3.0:1787387991.565543:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858688 00000100:00100000:3.0:1787387991.565563:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858816 00000100:00100000:3.0:1787387991.565565:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858816 00000100:00100000:3.0:1787387991.565582:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787387991.565613:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971858176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565711:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971858176:12345-0@lo:400:kworker.0 Request processed in 120us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.565718:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787387991.565735:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787387991.565742:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971858688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565771:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971858688:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.565776:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787387991.565788:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787387991.565794:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971858816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565837:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971858816:12345-0@lo:400:kworker.0 Request processed in 44us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.565844:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787387991.565887:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5ad80 x1874211971858816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387991.565900:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971858816:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565911:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971858176:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.565919:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971858688:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566256:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858304 00000100:00100000:2.0:1787387991.566267:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858304 00000100:00100000:2.0:1787387991.566306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787387991.566313:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971858304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566360:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971858304:12345-0@lo:400:kworker.0 Request processed in 48us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.566366:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787387991.566382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387991.566386:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387991.566398:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971858048:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.566448:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971858560:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.566497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971859072:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.566539:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787387991.566545:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971857920:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.566612:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971858432:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.566650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971858944:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.566669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.566720:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858048 00000100:00100000:2.0:1787387991.566724:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858048 00000100:00100000:2.0:1787387991.566746:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859072 00000100:00100000:2.0:1787387991.566748:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859072 00000100:00100000:0.0:1787387991.566957:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858560 00000100:00100000:0.0:1787387991.566961:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858560 00000100:00100000:0.0:1787387991.566989:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858432 00000100:00100000:0.0:1787387991.566992:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858432 00000100:00100000:0.0:1787387991.567011:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387991.567017:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971858560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387991.567059:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971858560:12345-0@lo:400:kworker.0 Request processed in 42us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387991.567064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387991.567076:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387991.567091:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971858432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.567253:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971858944 00000100:00100000:2.0:1787387991.567257:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971858944 00000100:00100000:2.0:1787387991.567284:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787387991.567289:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971858048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.567381:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971857920 00000100:00100000:1.0:1787387991.567386:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971857920 00000100:00100000:1.0:1787387991.567412:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787387991.567418:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971857920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.567500:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787387991.567508:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971859072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.574692:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971858048:12345-0@lo:400:kworker.0 Request processed in 7374us (8236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.574709:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787387991.574750:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787387991.574764:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971858944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.574822:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971858944:12345-0@lo:400:kworker.0 Request processed in 66us (8152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.574829:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787387991.574864:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387991.574872:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387991.574876:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787387991.574961:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971858304:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.575011:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971858944:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.575021:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971858048:0@lo:400:kworker.0 00010000:00080000:2.0:1787387991.575036:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5b100 x1874211971858560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387991.575047:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971858560:0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.576940:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971857920:12345-0@lo:400:kworker.0 Request processed in 9513us (10358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387991.576955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787387991.585457:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971857920:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.586941:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971859072:12345-0@lo:400:kworker.0 Request processed in 19426us (20414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.586956:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787387991.587200:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971858432:12345-0@lo:400:kworker.0 Request processed in 20107us (20561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387991.587209:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787387991.589241:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5b480 x1874211971859072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387991.589259:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971859072:0@lo:400:kworker.0 00010000:00080000:2.0:1787387991.589317:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d59500 x1874211971858432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387991.589325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971858432:0@lo:400:kworker.0 00010000:00010000:2.0:1787387992.201807:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387992.405413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387992.406276:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924160 00000100:00100000:2.0:1787387992.406290:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924160 00000100:00100000:2.0:1787387992.406359:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 244 00000100:00100000:2.0:1787387992.406370:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:6174:x1874211952924160:12345-192.168.204.52@tcp:101: 00010000:00010000:2.0:1787387992.406386:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387992.406410:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ba1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387992.406455:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ba1 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387992.406467:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ba1 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387992.406477:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff200, rc 0) 00000100:00100000:2.0:1787387992.406550:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952924160:12345-192.168.204.52@tcp:101: Request processed in 181us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387992.406558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 244 00000100:00100000:0.0:1787387992.408927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387992.409953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387992.409988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387992.410121:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924544 00000100:00100000:1.0:1787387992.410131:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924544 00000100:00100000:1.0:1787387992.410194:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787387992.410214:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952924544:12345-192.168.204.52@tcp:400: 00000100:00100000:1.0:1787387992.410298:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952924544:12345-192.168.204.52@tcp:400: Request processed in 86us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387992.410306:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:3.0:1787387992.410831:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924288 00000100:00100000:3.0:1787387992.410837:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924288 00000100:00100000:3.0:1787387992.410884:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924416 00000100:00100000:3.0:1787387992.410888:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924416 00000100:00100000:3.0:1787387992.410915:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:3.0:1787387992.410922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952924288:12345-192.168.204.52@tcp:400: 00000100:00100000:3.0:1787387992.410970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952924288:12345-192.168.204.52@tcp:400: Request processed in 48us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387992.410977:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:3.0:1787387992.410990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:3.0:1787387992.410996:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952924416:12345-192.168.204.52@tcp:400: 00000100:00100000:3.0:1787387992.411020:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952924416:12345-192.168.204.52@tcp:400: Request processed in 25us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387992.411026:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:0.0:1787387992.411482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00080000:2.0:1787387992.413843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387992.413856:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387992.413859:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387992.413876:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924672 00000100:00100000:2.0:1787387992.413887:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924672 00000100:00100000:2.0:1787387992.413987:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:2.0:1787387992.414014:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952924672:12345-192.168.204.52@tcp:400: 00000100:00100000:2.0:1787387992.414121:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952924672:12345-192.168.204.52@tcp:400: Request processed in 109us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387992.414129:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00080000:0.0:1787387992.416479:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387992.424997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387992.425751:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924800 00000100:00100000:1.0:1787387992.425763:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924800 00000100:00100000:1.0:1787387992.425836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 245 00000100:00100000:1.0:1787387992.425847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952924800:12345-192.168.204.52@tcp:501: 00000100:00100000:1.0:1787387992.426025:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952924800:12345-192.168.204.52@tcp:501: Request processed in 179us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387992.426033:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 245 00000100:00100000:0.0:1787387992.430830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387992.430966:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952924928 00000100:00100000:2.0:1787387992.430977:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952924928 00000100:00100000:2.0:1787387992.431464:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 246 00000100:00100000:2.0:1787387992.431477:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952924928:12345-192.168.204.52@tcp:503: 00000100:00100000:2.0:1787387992.431656:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952924928:12345-192.168.204.52@tcp:503: Request processed in 174us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387992.431664:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 246 00000100:00100000:0.0:1787387992.437081:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387992.438005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925056 00000100:00100000:1.0:1787387992.438021:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925056 00000100:00100000:1.0:1787387992.438114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 247 00000100:00100000:1.0:1787387992.438143:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6686:x1874211952925056:12345-192.168.204.52@tcp:502: 00000100:00100000:1.0:1787387992.438548:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6686:x1874211952925056:12345-192.168.204.52@tcp:502: Request processed in 405us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387992.438557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 247 00000100:00100000:1.0:1787387992.444018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387992.444195:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925184 00000100:00100000:2.0:1787387992.444351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925184 00000100:00100000:2.0:1787387992.444416:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 248 00000100:00100000:2.0:1787387992.444496:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6686:x1874211952925184:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387992.444936:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6686:x1874211952925184:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 508us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387992.444945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 248 00000100:00100000:0.0:1787387992.455978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387992.456940:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925312 00000100:00100000:3.0:1787387992.456954:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925312 00000100:00100000:3.0:1787387992.457074:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 249 00000100:00100000:3.0:1787387992.457094:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952925312:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387992.457110:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387992.457150:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0030400/0x5cb77467b1811b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ba8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387992.457186:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0030400/0x5cb77467b1811b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ba8 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387992.457213:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0030400/0x5cb77467b1811b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ba8 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387992.457224:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030400, rc 0) 00000100:00100000:3.0:1787387992.458006:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925312:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 918us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387992.458016:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 249 00000100:00100000:1.0:1787387992.464904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387992.465349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925440 00000100:00100000:2.0:1787387992.465359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925440 00000100:00100000:2.0:1787387992.465423:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 250 00000100:00100000:2.0:1787387992.465434:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925440:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387992.466031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925440:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 595us (1135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387992.466041:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 250 00010000:00010000:3.0:1787387993.224047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787387994.156335:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffee9d52a40 00000020:00000080:0.0:1787387994.156353:0:10399:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787387994.156358:0:10399:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787387994.156366:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee9d54cd0 20000000:00000080:0.0:1787387994.156374:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9272c36f6800 uarg=0000000000000000 20000000:01000000:0.0:1787387994.156423:0:10399:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787387994.156429:0:10399:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787387994.156434:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787387994.157073:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787387994.157323:0:10399:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787387994.162940:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787387994.162978:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787387994.162997:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787387994.163014:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787387994.163035:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163056:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b18117ce expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163650:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811861 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163660:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811899 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163667:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811964 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163728:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163737:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163782:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.163798:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 9 pid: 6513 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.163814:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859200:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787387994.164070:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811964 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.164079:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811964 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.164088:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859328:0@lo:104: 00000100:00100000:0.0:1787387994.164138:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387994.164182:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811899 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.164190:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811899 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.164199:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d59c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859456:0@lo:104: 00000100:00100000:0.0:1787387994.164223:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387994.164247:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811861 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.164255:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811861 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.164263:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859584:0@lo:104: 00010000:00010000:0.0:1787387994.164287:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b18117ce expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.164294:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b18117ce expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.164302:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859712:0@lo:104: 00000100:00100000:0.0:1787387994.164318:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0603cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387994.165207:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787387994.165235:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387994.165251:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387994.165260:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859328 00000100:00100000:2.0:1787387994.165268:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859328 00000100:00100000:2.0:1787387994.165313:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859456 00000100:00100000:2.0:1787387994.165316:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859456 00000100:00100000:2.0:1787387994.165328:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859584 00000100:00100000:2.0:1787387994.165330:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859584 00000100:00100000:2.0:1787387994.165340:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859712 00000100:00100000:2.0:1787387994.165343:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859712 00000100:00100000:2.0:1787387994.165356:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787387994.165364:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:10399:x1874211971859328:12345-0@lo:104: 00010000:00010000:2.0:1787387994.165377:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165439:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387994.165446:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:10399:x1874211971859328:12345-0@lo:104: Request processed in 83us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.165453:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787387994.165472:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787387994.165478:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:10399:x1874211971859456:12345-0@lo:104: 00010000:00010000:2.0:1787387994.165485:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165521:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387994.165526:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:10399:x1874211971859456:12345-0@lo:104: Request processed in 49us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.165531:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787387994.165599:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387994.165606:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:10399:x1874211971859584:12345-0@lo:104: 00010000:00010000:2.0:1787387994.165614:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165647:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787387994.165652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:10399:x1874211971859584:12345-0@lo:104: Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.165658:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387994.165671:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387994.165695:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:10399:x1874211971859712:12345-0@lo:104: 00010000:00010000:2.0:1787387994.165702:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165732:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787387994.165736:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:10399:x1874211971859712:12345-0@lo:104: Request processed in 60us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.165742:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787387994.165756:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787387994.165761:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165768:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b600 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387994.165772:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165781:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387994.165798:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387994.165803:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387994.165831:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165838:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387994.165858:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165865:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152b600/0x5cb77467b1811964 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b181196b expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165884:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787387994.165888:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165893:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387994.165896:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165903:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387994.165909:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387994.165914:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387994.165934:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165939:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387994.165946:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165952:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafa800/0x5cb77467b1811899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18118a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165963:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387994.165966:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165973:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafac00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387994.165976:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.165982:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387994.165989:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387994.165994:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387994.166005:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166010:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387994.166024:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166040:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafac00/0x5cb77467b1811861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811868 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166049:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387994.166052:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166057:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1485800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787387994.166060:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166066:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387994.166072:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387994.166077:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387994.166089:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166094:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387994.166100:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166106:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1485800/0x5cb77467b18117ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b18117d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166120:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387994.166127:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387994.166129:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387994.166136:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387994.166140:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387994.166159:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971859840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387994.166222:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387994.166227:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971859968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387994.166270:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971860224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387994.166306:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387994.166311:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971860096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387994.166348:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859840 00000100:00100000:2.0:1787387994.166352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859840 00010000:00010000:2.0:1787387994.166371:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811964 expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387994.166384:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971859968 00000100:00100000:2.0:1787387994.166386:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971859968 00010000:00010000:2.0:1787387994.166394:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811899 expref: 25 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387994.166404:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860224 00000100:00100000:2.0:1787387994.166406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860224 00010000:00010000:2.0:1787387994.166414:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18117ce expref: 26 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387994.166423:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860096 00000100:00100000:2.0:1787387994.166431:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860096 00010000:00010000:2.0:1787387994.166443:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811861 expref: 27 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387994.166456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387994.166462:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+27:3644:x1874211971859840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387994.166471:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387994.166476:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811964 expref: 27 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166485:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811964 expref: 27 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166499:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387994.166525:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+27:3644:x1874211971859840:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.166531:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387994.166543:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387994.166562:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+26:3644:x1874211971859968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387994.166570:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387994.166574:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811899 expref: 26 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166581:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811899 expref: 26 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166590:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387994.166610:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+26:3644:x1874211971859968:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.166616:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387994.166635:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387994.166641:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+25:3647:x1874211971860224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387994.166648:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387994.166653:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b18117ce expref: 25 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166661:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b18117ce expref: 25 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166670:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387994.166716:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+25:3647:x1874211971860224:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.166723:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387994.166734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387994.166740:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971860096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387994.166747:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387994.166751:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811861 expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166758:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811861 expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387994.166767:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387994.166788:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971860096:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.166794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387994.166854:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971859968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166864:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971859840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971860096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387994.166908:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971860224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387994.167447:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe400/0x5cb77467b181196b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811964 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.167462:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859328:0@lo:104: 00010000:00010000:0.0:1787387994.167473:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1485000/0x5cb77467b18118a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811899 expref: 22 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.167494:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d59c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859456:0@lo:104: 00010000:00010000:0.0:1787387994.167505:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1482800/0x5cb77467b1811868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811861 expref: 21 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.167513:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859584:0@lo:104: 00010000:00010000:0.0:1787387994.167520:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafa400/0x5cb77467b18117d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b18117ce expref: 20 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.167528:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859712:0@lo:104: 00010000:00010000:3.0:1787387994.168802:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387994.170698:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387994.170787:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925568 00000100:00100000:3.0:1787387994.170798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925568 00010000:00010000:3.0:1787387994.170841:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 10 pid: 6513 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387994.170931:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 39 00000100:00100000:3.0:1787387994.170941:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952925568:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387994.170956:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387994.170962:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 10 pid: 6513 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.170976:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 10 pid: 6513 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.170999:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171025:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171044:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171052:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171059:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171066:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171072:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787387994.171077:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171086:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171096:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.171109:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387994.171290:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952925568:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 349us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387994.171298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 39 00010000:00010000:0.0:1787387994.171527:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152b800/0x5cb77467b1811a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b69 expref: 9 pid: 6513 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387994.171557:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1874211971859200:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787387994.171591:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.171601:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.171607:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387994.171614:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387994.247766:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387994.632152:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387994.632179:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971860352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387994.632258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387994.632391:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860352 00000100:00100000:0.0:1787387994.632399:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860352 00000100:00100000:0.0:1787387994.632462:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787387994.632626:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387994.632699:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971860352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387994.632731:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387994.632778:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971860352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387994.633847:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387994.633865:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971860480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787387994.633922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787387994.634022:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d58700 x1874211971860352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387994.634046:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971860352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387994.634372:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860480 00000100:00100000:2.0:1787387994.634379:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860480 00000100:00080000:3.0:1787387994.634586:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387994.641564:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387994.643034:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387994.643057:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971860480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787387994.643085:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387994.643446:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971860480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 399us (9523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387994.643455:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787387994.650144:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4e00 x1874211971860480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387994.650178:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971860480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787387995.144063:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387995.144089:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971860608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787387995.144524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387995.144606:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860608 00000100:00100000:3.0:1787387995.144616:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860608 00000100:00100000:3.0:1787387995.144665:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387995.144675:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971860608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787387995.144757:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787387995.144814:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971860608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387995.144821:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787387995.144927:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971860608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787387995.272804:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387995.486492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387995.491311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925696 00000100:00100000:3.0:1787387995.491332:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925696 00000100:00100000:3.0:1787387995.491412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 251 00000100:00100000:3.0:1787387995.491425:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:6174:x1874211952925696:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387995.491445:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387995.491469:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4baf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387995.491515:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387995.491538:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387995.491547:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030a00, rc 0) 00000100:00100000:3.0:1787387995.491630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925696:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 207us (5148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387995.491638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 251 00000100:00100000:3.0:1787387995.497887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387995.498608:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925824 00000100:00100000:0.0:1787387995.498622:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925824 00000100:00100000:0.0:1787387995.498716:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 252 00000100:00100000:0.0:1787387995.498727:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925824:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387995.498906:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925824:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 180us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387995.498915:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 252 00000100:00100000:2.0:1787387995.506416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787387995.506541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952925952 00000100:00100000:1.0:1787387995.506556:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952925952 00000100:00100000:1.0:1787387995.506632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 253 00000100:00100000:1.0:1787387995.506644:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925952:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387995.506828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6174:x1874211952925952:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 185us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387995.506837:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 253 00000100:00100000:1.0:1787387995.519867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787387995.520131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926080 00000100:00100000:3.0:1787387995.520143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926080 00000100:00100000:3.0:1787387995.520207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 254 00000100:00100000:3.0:1787387995.520220:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6743:x1874211952926080:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387995.520406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6743:x1874211952926080:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 188us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387995.520416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 254 00000100:00100000:2.0:1787387995.531592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387995.531707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926208 00000100:00100000:0.0:1787387995.531720:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926208 00000100:00100000:0.0:1787387995.531792:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 255 00000100:00100000:0.0:1787387995.531804:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6743:x1874211952926208:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387995.531973:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:6743:x1874211952926208:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 171us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387995.531981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 255 10000000:01000000:0.0:1787387996.043237:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387996.043246:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401ba8000 from 4 10000000:01000000:0.0:1787387996.043252:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387996.043301:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.043313:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.043347:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387996.043374:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971860736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.043451:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.045752:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387996.046943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860736 00000100:00100000:3.0:1787387996.046955:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860736 00000100:00100000:3.0:1787387996.047242:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787387996.047254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971860736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387996.047273:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387996.047294:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b55 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.047336:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.047346:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.047356:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031e00, rc 0) 00000100:00100000:3.0:1787387996.047441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971860736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.047449:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787387996.048898:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971860736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387996.048925:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.048937:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387996.049095:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971860864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.049152:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.049278:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387996.049382:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860864 00000100:00100000:3.0:1787387996.049389:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860864 00000100:00100000:3.0:1787387996.049436:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787387996.049446:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971860864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.049590:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971860864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.049598:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787387996.049636:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971860864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.049664:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971860992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.049726:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387996.049847:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387996.049860:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971860992 00000100:00100000:3.0:1787387996.049863:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971860992 00000100:00100000:3.0:1787387996.049886:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787387996.049892:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971860992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.049976:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971860992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.049997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787387996.050963:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971860992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.057241:0:10471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10471:1874211971861120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387996.057324:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.057369:0:10471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.057501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861120 00000100:00100000:0.0:1787387996.057509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861120 00000100:00100000:0.0:1787387996.057572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787387996.057582:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10471:x1874211971861120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387996.057756:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10471:x1874211971861120:12345-0@lo:502:llog_process_th.0 Request processed in 174us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.057764:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787387996.058079:0:10471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10471:1874211971861120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387996.058113:0:10471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387996.058124:0:10471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387996.058127:0:10471:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787387996.058135:0:10471:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff927401ba8000 00000020:00000080:2.0:1787387996.058138:0:10471:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387996.058352:0:10471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10471:1874211971861248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387996.058394:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.058431:0:10471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387996.059120:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861248 00000100:00100000:2.0:1787387996.059128:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861248 00000100:00100000:2.0:1787387996.059177:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787387996.059186:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10471:x1874211971861248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387996.059306:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:10471:x1874211971861248:12345-0@lo:502:llog_process_th.0 Request processed in 120us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.059314:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787387996.059361:0:10471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10471:1874211971861248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387996.059384:0:10471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387996.059391:0:10471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387996.059393:0:10471:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787387996.059397:0:10471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787387996.059459:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787387996.059480:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387996.059491:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059503:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387996.059526:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387996.059529:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eef18800 from 4 10000000:01000000:2.0:1787387996.059533:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387996.059559:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059578:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059589:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387996.059606:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971861376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.059635:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.059651:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387996.059665:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861376 00000100:00100000:2.0:1787387996.059669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861376 00000100:00100000:2.0:1787387996.059709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787387996.059716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971861376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387996.059725:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387996.059749:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059769:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059780:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059789:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff400, rc 0) 00000100:00100000:2.0:1787387996.059818:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971861376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.059824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787387996.059864:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971861376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387996.059876:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.059886:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387996.059930:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971861504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.059955:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.059966:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387996.059976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861504 00000100:00100000:2.0:1787387996.059979:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861504 00000100:00100000:2.0:1787387996.059997:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787387996.060002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971861504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.062981:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971861504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2969us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.062994:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787387996.063415:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971861504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.063468:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971861632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.063527:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.063557:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387996.063571:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861632 00000100:00100000:2.0:1787387996.063577:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861632 00000100:00100000:2.0:1787387996.063615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787387996.063623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971861632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.063730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971861632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.065539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787387996.065625:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971861632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.068109:0:10473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10473:1874211971861760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387996.068388:0:10473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387996.068430:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861760 00000100:00100000:3.0:1787387996.068437:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861760 00000100:00100000:3.0:1787387996.068482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787387996.068491:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10473:x1874211971861760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387996.068616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10473:x1874211971861760:12345-0@lo:502:llog_process_th.0 Request processed in 126us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.068624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787387996.068675:0:10473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787387996.068717:0:10473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10473:1874211971861760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387996.071373:0:10473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387996.071390:0:10473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387996.071392:0:10473:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787387996.071400:0:10473:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273eef18800 00000020:00000080:3.0:1787387996.071403:0:10473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387996.079037:0:10473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10473:1874211971861888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387996.079126:0:10473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387996.079179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971861888 00000100:00100000:3.0:1787387996.079187:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971861888 00000100:00100000:3.0:1787387996.079237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787387996.079245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10473:x1874211971861888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387996.079357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:10473:x1874211971861888:12345-0@lo:502:llog_process_th.0 Request processed in 111us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.079365:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787387996.079418:0:10473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787387996.079440:0:10473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10473:1874211971861888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387996.079466:0:10473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387996.079473:0:10473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387996.079476:0:10473:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787387996.079479:0:10473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787387996.079886:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787387996.079912:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387996.079923:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.079934:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387996.079945:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387996.079947:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eedc0000 from 4 10000000:01000000:2.0:1787387996.079950:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387996.079978:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.079986:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387996.079995:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387996.080121:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387996.081148:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.083436:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.087146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862016 00000100:00100000:0.0:1787387996.087169:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862016 00000100:00100000:0.0:1787387996.087224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787387996.087244:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971862016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387996.087262:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387996.087279:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b71 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.087306:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.087319:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.087329:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:0.0:1787387996.087416:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971862016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (6271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.087424:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787387996.087488:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387996.087505:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.087526:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387996.087603:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.087635:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.087660:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387996.088386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862144 00000100:00100000:3.0:1787387996.088397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862144 00000100:00100000:3.0:1787387996.088435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787387996.088442:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971862144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.088579:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971862144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.088586:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787387996.091403:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.091468:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.091559:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.091600:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.091621:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862272 00000100:00100000:0.0:1787387996.091628:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862272 00000100:00100000:0.0:1787387996.091698:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787387996.091708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971862272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.091914:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971862272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.091922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787387996.091977:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387996.092944:0:10476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10476:1874211971862400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387996.092995:0:10476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.093063:0:10476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.096993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862400 00000100:00100000:0.0:1787387996.097007:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862400 00000100:00100000:1.0:1787387996.097115:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787387996.097132:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10476:x1874211971862400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387996.097431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10476:x1874211971862400:12345-0@lo:502:llog_process_th.0 Request processed in 300us (4434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.097440:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787387996.098879:0:10476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10476:1874211971862400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387996.098941:0:10476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387996.098952:0:10476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387996.098954:0:10476:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787387996.098960:0:10476:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273eedc0000 00000020:00000080:0.0:1787387996.098962:0:10476:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787387996.099321:0:10476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10476:1874211971862528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387996.099379:0:10476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.099415:0:10476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387996.099478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862528 00000100:00100000:1.0:1787387996.099484:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862528 00000100:00100000:1.0:1787387996.099526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787387996.099535:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10476:x1874211971862528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387996.099704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:10476:x1874211971862528:12345-0@lo:502:llog_process_th.0 Request processed in 169us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.099712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787387996.100559:0:10476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10476:1874211971862528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387996.100588:0:10476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387996.100596:0:10476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387996.100598:0:10476:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787387996.100603:0:10476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787387996.101102:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787387996.101126:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787387996.101140:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387996.101233:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387996.101245:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787387996.101248:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c9714000 from 4 10000000:01000000:1.0:1787387996.101251:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787387996.101283:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387996.101292:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387996.101302:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387996.101327:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387996.101379:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.101452:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.103799:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862656 00000100:00100000:0.0:1787387996.103826:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862656 00000100:00100000:3.0:1787387996.104068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787387996.104082:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971862656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387996.104101:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387996.104121:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811b7f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.104153:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.104165:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.104277:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031400, rc 0) 00000100:00100000:3.0:1787387996.104358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971862656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.104365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787387996.104415:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387996.104439:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.104449:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387996.104545:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387996.104658:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387996.104813:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.105290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862784 00000100:00100000:0.0:1787387996.105297:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862784 00000100:00100000:0.0:1787387996.105329:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787387996.105337:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971862784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.105482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971862784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.105489:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787387996.105801:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.105839:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.105907:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.105925:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.105937:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971862912 00000100:00100000:0.0:1787387996.105941:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971862912 00000100:00100000:0.0:1787387996.105958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787387996.105964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971862912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.106039:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971862912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.106046:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787387996.106084:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971862912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387996.106241:0:10477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10477:1874211971863040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387996.106273:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.106290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863040 00000100:00100000:0.0:1787387996.106294:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863040 00000100:00100000:0.0:1787387996.106310:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787387996.106315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:10477:x1874211971863040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387996.106384:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:10477:x1874211971863040:12345-0@lo:502:llog_process_th.0 Request processed in 68us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.106391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787387996.106417:0:10477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.106428:0:10477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10477:1874211971863040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387996.106449:0:10477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387996.106458:0:10477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387996.106461:0:10477:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787387996.106468:0:10477:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273c9714000 00000020:00000080:0.0:1787387996.106470:0:10477:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787387996.106548:0:10477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10477:1874211971863168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387996.106579:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387996.106597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863168 00000100:00100000:0.0:1787387996.106601:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863168 00000100:00100000:0.0:1787387996.106617:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787387996.106622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:10477:x1874211971863168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387996.106697:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:10477:x1874211971863168:12345-0@lo:502:llog_process_th.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387996.106704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787387996.106730:0:10477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387996.106742:0:10477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:10477:1874211971863168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387996.106759:0:10477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387996.106763:0:10477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387996.106764:0:10477:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787387996.106768:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787387996.106808:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787387996.106836:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387996.106845:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387996.106856:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387996.295814:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387996.684762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971863296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787387996.684831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.684895:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971863424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387996.684916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.684953:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863296 00000100:00100000:1.0:1787387996.684960:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863296 00000100:00100000:1.0:1787387996.685005:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863424 00000100:00100000:1.0:1787387996.685007:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863424 00000100:00100000:1.0:1787387996.685023:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387996.685030:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971863296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787387996.685057:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387996.685096:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971863296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.685104:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387996.685121:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387996.685126:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971863424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387996.685134:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387996.685157:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971863424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.685161:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787387996.685177:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787387996.685203:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f1500 x1874211971863424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387996.685229:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971863424:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787387996.685257:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f2680 x1874211971863296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387996.685267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971863296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787387996.687525:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971863680:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.687591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.687650:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971864192:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.687697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.687720:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971864704:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.687746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.687779:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787387996.687788:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971863808:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.687810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.687828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971864320:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.687847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.687861:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971864832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787387996.687877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.687905:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864192 00000100:00100000:1.0:1787387996.687915:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864192 00000100:00100000:1.0:1787387996.687968:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387996.687977:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971864192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.688029:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971864192:12345-0@lo:400:kworker.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.688056:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387996.688079:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864704 00000100:00100000:1.0:1787387996.688083:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864704 00000100:00100000:1.0:1787387996.688110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863808 00000100:00100000:1.0:1787387996.688112:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863808 00000100:00100000:1.0:1787387996.688123:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864320 00000100:00100000:1.0:1787387996.688125:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864320 00000100:00100000:1.0:1787387996.688139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387996.688146:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971864704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.688177:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971864704:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.688183:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387996.688196:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387996.688202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971863808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.688227:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971863808:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.688233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387996.688244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387996.688249:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971864320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.688274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971864320:12345-0@lo:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.688280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387996.688302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863680 00000100:00100000:1.0:1787387996.688305:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863680 00000100:00100000:1.0:1787387996.688327:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864832 00000100:00100000:1.0:1787387996.688330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864832 00000100:00100000:1.0:1787387996.688341:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387996.688354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971863680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.688573:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787387996.688584:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971864832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787387996.688607:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787387996.691328:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971864832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2740us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.691343:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787387996.691642:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971863680:12345-0@lo:400:kworker.0 Request processed in 3286us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.691650:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387996.691715:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971863552:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.692369:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971864064:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.692552:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971864576:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.692604:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787387996.692612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971863936:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.692657:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971864448:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387996.692728:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864064 00000100:00100000:1.0:1787387996.692749:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864064 00000100:00100000:1.0:1787387996.692798:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387996.692807:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971864064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692875:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971864064:12345-0@lo:400:kworker.0 Request processed in 68us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.692882:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387996.692903:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863552 00000100:00100000:1.0:1787387996.692906:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863552 00000100:00100000:1.0:1787387996.692924:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864576 00000100:00100000:1.0:1787387996.692927:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864576 00000100:00100000:1.0:1787387996.692947:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864448 00000100:00100000:1.0:1787387996.692949:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864448 00000100:00100000:1.0:1787387996.692961:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787387996.692966:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971863552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.692994:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971863552:12345-0@lo:400:kworker.0 Request processed in 27us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.692999:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787387996.693010:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787387996.693015:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971864576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.694367:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971864576:12345-0@lo:400:kworker.0 Request processed in 1345us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.694379:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787387996.694402:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787387996.694412:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971864448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.694442:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971864448:12345-0@lo:400:kworker.0 Request processed in 33us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.694448:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787387996.694485:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387996.694489:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787387996.694492:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387996.694514:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971863936 00000100:00100000:1.0:1787387996.694519:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971863936 00000100:00100000:1.0:1787387996.694548:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387996.694554:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971863936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.694585:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971863936:12345-0@lo:400:kworker.0 Request processed in 31us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.694590:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387996.694651:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971863936:0@lo:400:kworker.0 00010000:00080000:1.0:1787387996.694665:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3618700 x1874211971864448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387996.694694:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971864448:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.694707:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971863552:0@lo:400:kworker.0 00010000:00080000:1.0:1787387996.694718:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc6680 x1874211971864064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387996.694726:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971864064:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.694749:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971864576:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.694788:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971863808:0@lo:400:kworker.0 00000100:00100000:0.0:1787387996.696559:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971864320:0@lo:400:kworker.0 00000100:00100000:0.0:1787387996.696581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971864832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787387996.696591:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971863680:0@lo:400:kworker.0 00010000:00080000:0.0:1787387996.696604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7480 x1874211971864192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387996.696615:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971864192:0@lo:400:kworker.0 00010000:00080000:0.0:1787387996.696628:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa86300 x1874211971864704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387996.696637:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971864704:0@lo:400:kworker.0 00010000:00010000:2.0:1787387997.321120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387997.535853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387997.535966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387997.536035:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387997.536064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787387997.536093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926336 00000100:00100000:2.0:1787387997.536102:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926336 00000100:00100000:2.0:1787387997.536163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 276 00000100:00100000:2.0:1787387997.536173:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2402:x1874211952926336:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787387997.536263:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2402:x1874211952926336:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 68us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387997.536273:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 276 00000100:00100000:3.0:1787387997.536590:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926720 00000100:00100000:3.0:1787387997.536599:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926720 00000100:00100000:3.0:1787387997.536652:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:3.0:1787387997.536662:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952926720:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787387997.536716:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952926720:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 57us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387997.536723:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00080000:2.0:1787387997.537220:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387997.537559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787387997.537599:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926848 00000100:00100000:0.0:1787387997.537605:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926848 00000100:00100000:0.0:1787387997.537642:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 28 00000100:00100000:0.0:1787387997.537650:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952926848:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787387997.537729:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952926848:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387997.537736:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 28 00000100:00100000:1.0:1787387997.537951:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926464 00000100:00100000:1.0:1787387997.537957:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926464 00000100:00100000:1.0:1787387997.538000:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926592 00000100:00100000:1.0:1787387997.538004:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926592 00000100:00100000:1.0:1787387997.538036:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:1.0:1787387997.538044:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952926464:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787387997.538075:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952926464:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 32us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387997.538082:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:1.0:1787387997.538094:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00100000:1.0:1787387997.538100:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952926592:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787387997.538123:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952926592:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 23us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387997.538345:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00080000:2.0:1787387997.538441:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387997.538445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387997.538447:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787387998.344085:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387999.368122:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387999.753926:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971864960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787387999.754032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387999.754097:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971865088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387999.754121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387999.754164:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971864960 00000100:00100000:1.0:1787387999.754173:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971864960 00000100:00100000:0.0:1787387999.754305:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865088 00000100:00100000:0.0:1787387999.754309:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865088 00000100:00100000:1.0:1787387999.754378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387999.754387:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971864960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787387999.754415:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387999.754474:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971864960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387999.754482:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787387999.755521:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5ad80 x1874211971864960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387999.755545:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971864960:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787387999.759542:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387999.759747:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387999.759762:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971865088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387999.759790:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387999.759877:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971865088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (5754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387999.759885:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787387999.760015:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7480 x1874211971865088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387999.760037:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971865088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388000.264766:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388000.264792:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971865216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388000.264872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388000.264932:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865216 00000100:00100000:1.0:1787388000.264940:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865216 00000100:00100000:1.0:1787388000.264983:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787388000.264992:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971865216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388000.265023:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388000.265076:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971865216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388000.265084:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787388000.265131:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971865216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388000.394392:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388000.854669:0:10699:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787388001.416020:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388001.800111:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971865472:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800256:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971865984:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800314:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971866496:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800367:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787388001.800374:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971865344:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800446:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971865856:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800486:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971866368:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800660:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971866880:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800741:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971865728:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800803:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971866240:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800830:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971866752:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800864:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388001.800869:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971865600:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.800912:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971866112:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.800930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.801124:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865856 00000100:00100000:1.0:1787388001.801132:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865856 00000100:00100000:1.0:1787388001.801173:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865600 00000100:00100000:1.0:1787388001.801176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865600 00000100:00100000:1.0:1787388001.801191:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388001.801213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971865856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.801272:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971865856:12345-0@lo:400:kworker.0 Request processed in 73us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.801280:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388001.801296:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787388001.801302:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971865600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.801329:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971865600:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.801335:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787388001.801421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388001.801430:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971867008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388001.801457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.801482:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867008 00000100:00100000:1.0:1787388001.801485:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867008 00000100:00100000:1.0:1787388001.801518:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787388001.801721:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971867008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388001.801744:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388001.801782:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971867008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 257us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.801795:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787388001.801811:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388001.801824:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971867136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388001.801848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.801876:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867136 00000100:00100000:1.0:1787388001.801880:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867136 00000100:00100000:1.0:1787388001.801906:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787388001.801911:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971867136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388001.801920:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388001.805250:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865472 00000100:00100000:2.0:1787388001.805266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865472 00000100:00100000:2.0:1787388001.805317:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866496 00000100:00100000:2.0:1787388001.805321:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866496 00000100:00100000:2.0:1787388001.805336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866368 00000100:00100000:2.0:1787388001.805339:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866368 00000100:00100000:2.0:1787388001.805351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865728 00000100:00100000:2.0:1787388001.805353:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865728 00000100:00100000:2.0:1787388001.805365:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866240 00000100:00100000:2.0:1787388001.805367:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866240 00000100:00100000:2.0:1787388001.805386:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388001.805418:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971865472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.813142:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971866624:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.813220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388001.813263:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971865600:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.813307:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865984 00000100:00100000:3.0:1787388001.813313:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865984 00000100:00100000:3.0:1787388001.813354:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866880 00000100:00100000:3.0:1787388001.813357:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866880 00000100:00100000:3.0:1787388001.813370:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866752 00000100:00100000:3.0:1787388001.813372:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866752 00000100:00100000:3.0:1787388001.813381:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866112 00000100:00100000:3.0:1787388001.813406:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866112 00000100:00100000:3.0:1787388001.813426:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787388001.813434:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971865984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.813727:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971865984:12345-0@lo:400:kworker.0 Request processed in 291us (13436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.813735:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787388001.813887:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388001.813895:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971866880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.813926:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971866880:12345-0@lo:400:kworker.0 Request processed in 34us (13213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.813933:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388001.813944:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787388001.813951:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971866752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.814008:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971866752:12345-0@lo:400:kworker.0 Request processed in 58us (13159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.814015:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787388001.814026:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787388001.814033:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971866112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.814060:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971866112:12345-0@lo:400:kworker.0 Request processed in 29us (13130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.814066:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787388001.814084:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971866624 00000100:00100000:3.0:1787388001.814087:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971866624 00000100:00100000:3.0:1787388001.814109:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787388001.814116:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971866496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.814145:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971866496:12345-0@lo:400:kworker.0 Request processed in 30us (13808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.814150:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787388001.814165:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787388001.814172:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971866368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.814358:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971867136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12444us (12507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.814366:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787388001.814419:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388001.814424:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388001.814426:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388001.814429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388001.814457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7480 x1874211971867136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.814492:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971867136:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787388001.814525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3618700 x1874211971867008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.814538:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971867008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388001.814572:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971865856:0@lo:400:kworker.0 00010000:00080000:1.0:1787388001.814583:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85c00 x1874211971866368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.814607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971866368:0@lo:400:kworker.0 00010000:00080000:1.0:1787388001.814620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa84380 x1874211971866880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.814628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971866880:0@lo:400:kworker.0 00010000:00080000:1.0:1787388001.814639:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa87100 x1874211971865984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.814647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971865984:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.814658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971866496:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.815064:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971866368:12345-0@lo:400:kworker.0 Request processed in 891us (14553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.815072:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787388001.815092:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787388001.815100:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971865728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.815143:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971865728:12345-0@lo:400:kworker.0 Request processed in 45us (14358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.815148:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787388001.815168:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787388001.815175:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971866240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.815340:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971865472:12345-0@lo:400:kworker.0 Request processed in 9922us (15155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.815348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388001.815365:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787388001.815372:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971866624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.815426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971866624:12345-0@lo:400:kworker.0 Request processed in 55us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.815431:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787388001.815500:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388001.815512:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971867264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388001.815546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388001.815577:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867264 00000100:00100000:2.0:1787388001.815583:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867264 00000100:00100000:2.0:1787388001.815610:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388001.815617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971867264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388001.815641:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388001.815675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971867264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.815698:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388001.815733:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971867264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388001.815786:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971865344 00000100:00100000:2.0:1787388001.815790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971865344 00000100:00100000:2.0:1787388001.815815:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787388001.815821:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971865344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.815851:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971865344:12345-0@lo:400:kworker.0 Request processed in 30us (15427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.816287:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:2.0:1787388001.816368:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa87800 x1874211971866112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388001.816379:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971866112:0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.816670:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971866240:12345-0@lo:400:kworker.0 Request processed in 1494us (15845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.816688:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1787388001.816771:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa84e00 x1874211971866624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388001.816780:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971866624:0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.816792:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971865728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.816800:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971866240:0@lo:400:kworker.0 00010000:00080000:2.0:1787388001.816810:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85180 x1874211971866752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388001.816818:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971866752:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.818057:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971865344:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.818075:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971865472:0@lo:400:kworker.0 00010000:00010000:3.0:1787388002.440885:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388002.656364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388002.656420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388002.656476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388002.656583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927232 00000100:00100000:0.0:1787388002.656593:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927232 00000100:00100000:0.0:1787388002.656657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927104 00000100:00100000:0.0:1787388002.656660:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927104 00000100:00100000:0.0:1787388002.656721:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 87 00000100:00100000:0.0:1787388002.656731:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952927232:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388002.656810:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952927232:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 81us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388002.656818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 87 00000100:00100000:0.0:1787388002.656836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 88 00000100:00100000:0.0:1787388002.656841:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952927104:12345-192.168.204.52@tcp:400:kworker.0 00000100:00080000:3.0:1787388002.656990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388002.656994:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388002.657456:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952927104:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 609us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388002.657483:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 88 00000100:00100000:2.0:1787388002.657999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952926976 00000100:00100000:2.0:1787388002.658007:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952926976 00000100:00100000:2.0:1787388002.658056:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 278 00000100:00100000:2.0:1787388002.658064:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2404:x1874211952926976:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388002.658097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2404:x1874211952926976:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 34us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388002.658104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 278 00000100:00100000:3.0:1787388002.664791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388002.665256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388002.672646:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927360 00000100:00100000:0.0:1787388002.672662:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927360 00000100:00100000:0.0:1787388002.673618:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927488 00000100:00100000:0.0:1787388002.673627:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927488 00000100:00100000:2.0:1787388002.673717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:2.0:1787388002.673730:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2400:x1874211952927360:12345-192.168.204.52@tcp:9:kworker.0 00000020:00000080:2.0:1787388002.673769:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a98 00000100:00080000:2.0:1787388002.673793:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9272c2f65000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388002.673840:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787388002.674765:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388002.674780:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388002.674786:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388002.675046:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+2:2400:x1874211952927360:12345-192.168.204.52@tcp:9:kworker.0 Request processed in 1313us (10261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388002.675056:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:2.0:1787388002.675078:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:2.0:1787388002.675087:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2400:x1874211952927488:12345-192.168.204.52@tcp:9:kworker.0 00000020:00000080:2.0:1787388002.675106:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a9f 00000100:00080000:2.0:1787388002.675115:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9273fbf38000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388002.675145:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787388002.675214:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+2:2400:x1874211952927488:12345-192.168.204.52@tcp:9:kworker.0 Request processed in 129us (9959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388002.675220:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00010000:00010000:3.0:1787388002.675268:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388003.464199:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388004.493169:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388004.872111:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388004.873406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971867520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388004.873548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388004.873610:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971867392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388004.873635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388004.873856:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867520 00000100:00100000:1.0:1787388004.873864:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867520 00000100:00100000:1.0:1787388004.873914:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867392 00000100:00100000:1.0:1787388004.873916:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867392 00000100:00100000:1.0:1787388004.873934:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787388004.873942:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971867520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388004.874045:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388004.874098:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971867520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388004.874105:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787388004.874122:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388004.874130:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971867392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388004.874155:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388004.874182:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971867392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388004.874188:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787388004.874204:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388004.874239:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85180 x1874211971867520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388004.874257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971867520:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787388004.874270:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5aa00 x1874211971867392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388004.874281:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971867392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388005.383913:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971867648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388005.383991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388005.384130:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867648 00000100:00100000:0.0:1787388005.384138:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867648 00000100:00100000:0.0:1787388005.384196:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787388005.384206:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971867648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388005.384239:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388005.384299:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971867648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388005.384307:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787388005.384366:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971867648:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388005.513791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388006.536140:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388006.699949:0:10943:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing yml_node 00000100:00100000:0.0:1787388006.920487:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388006.920511:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971867776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388006.920582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.920645:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867776 00000100:00100000:0.0:1787388006.920654:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867776 00000100:00100000:0.0:1787388006.920726:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787388006.920737:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971867776:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388006.921312:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971867904:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921383:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971868416:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921423:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971868928:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921464:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971869440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388006.921487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921506:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787388006.921512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971868032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921548:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971868544:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921594:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971869056:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.921643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971867904 00000100:00100000:1.0:1787388006.921648:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971867904 00000100:00100000:1.0:1787388006.921703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787388006.921711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971867904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.921786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971867904:12345-0@lo:400:kworker.0 Request processed in 75us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388006.921794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000004:00000024:0.0:1787388006.922051:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388006.922090:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971867776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1354us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.922106:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787388006.922133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868928 00000100:00100000:0.0:1787388006.922136:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868928 00000100:00100000:0.0:1787388006.922168:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868032 00000100:00100000:0.0:1787388006.922171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868032 00000100:00100000:0.0:1787388006.922183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869056 00000100:00100000:0.0:1787388006.922186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869056 00000100:00100000:0.0:1787388006.922199:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787388006.922205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971868928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971868928:12345-0@lo:400:kworker.0 Request processed in 31us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.922244:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787388006.922255:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787388006.922262:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971868032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922288:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971868032:12345-0@lo:400:kworker.0 Request processed in 26us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.922294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787388006.922320:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787388006.922327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971869056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971869056:12345-0@lo:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.922361:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787388006.922378:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868416 00000100:00100000:0.0:1787388006.922381:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868416 00000100:00100000:0.0:1787388006.922403:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868544 00000100:00100000:0.0:1787388006.922406:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868544 00000100:00100000:0.0:1787388006.922424:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787388006.922439:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971868416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922469:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971868416:12345-0@lo:400:kworker.0 Request processed in 32us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.922475:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787388006.922486:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787388006.922492:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971868544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922518:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971868544:12345-0@lo:400:kworker.0 Request processed in 26us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.922524:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787388006.922539:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388006.922544:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388006.922546:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388006.922567:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971868160:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.922611:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971868672:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.922645:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971869184:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.922723:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971867776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388006.922743:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787388006.922748:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971868288:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.922788:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971868800:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.922818:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971869312:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.922861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388006.922887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868160 00000100:00100000:0.0:1787388006.922890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868160 00000100:00100000:0.0:1787388006.922906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868672 00000100:00100000:0.0:1787388006.922909:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868672 00000100:00100000:0.0:1787388006.922927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868800 00000100:00100000:0.0:1787388006.922930:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868800 00000100:00100000:1.0:1787388006.924410:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869184 00000100:00100000:1.0:1787388006.924420:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869184 00000100:00100000:1.0:1787388006.924444:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787388006.924457:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971868160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.924543:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971868160:12345-0@lo:400:kworker.0 Request processed in 90us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388006.924551:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787388006.924575:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388006.924583:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971868672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.924616:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971868672:12345-0@lo:400:kworker.0 Request processed in 35us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388006.924622:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388006.924644:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869440 00000100:00100000:1.0:1787388006.924648:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869440 00000100:00100000:1.0:1787388006.924699:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388006.924707:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971869440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388006.924740:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388006.924784:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971869440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388006.924791:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787388006.925243:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971868160:0@lo:400:kworker.0 00000100:00100000:2.0:1787388006.925256:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971868672:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.926145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787388006.926159:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971868800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.926236:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971868800:12345-0@lo:400:kworker.0 Request processed in 81us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.926243:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1787388006.926515:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2711c00 x1874211971868800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.926530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971868800:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.930237:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869312 00000100:00100000:0.0:1787388006.930252:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869312 00000100:00100000:0.0:1787388006.930360:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787388006.930371:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971869312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.930466:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971869312:12345-0@lo:400:kworker.0 Request processed in 97us (7603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.930472:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787388006.930544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5dc00 x1874211971869312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.930568:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971869312:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.930665:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971869568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388006.930730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388006.930818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971868032:0@lo:400:kworker.0 00010000:00080000:1.0:1787388006.930833:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2713b80 x1874211971868544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388006.930852:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971868544:0@lo:400:kworker.0 00010000:00080000:1.0:1787388006.930865:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5f800 x1874211971869056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388006.930874:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971869056:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.930885:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971867904:0@lo:400:kworker.0 00010000:00080000:1.0:1787388006.930896:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2710700 x1874211971868416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388006.930905:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971868416:0@lo:400:kworker.0 00000100:00100000:1.0:1787388006.930916:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971868928:0@lo:400:kworker.0 00010000:00080000:1.0:1787388006.930927:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5f480 x1874211971869440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.931131:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869568 00000100:00100000:3.0:1787388006.931136:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869568 00000100:00100000:3.0:1787388006.931173:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787388006.931180:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874211971869568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388006.931197:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388006.931236:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874211971869568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.931243:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388006.931491:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971869440:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787388006.931554:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa86d80 x1874211971869568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388006.931567:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971869568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388006.931646:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388006.931657:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971869184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388006.931728:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971869184:12345-0@lo:400:kworker.0 Request processed in 74us (9061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388006.931735:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787388006.932092:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5ed80 x1874211971869184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.932104:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971869184:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.932211:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971868288 00000100:00100000:0.0:1787388006.932217:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971868288 00000100:00100000:0.0:1787388006.932289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388006.932297:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971868288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.932364:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971868288:12345-0@lo:400:kworker.0 Request processed in 68us (9592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.932371:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787388006.932423:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971868288:0@lo:400:kworker.0 00000100:00080000:0.0:1787388006.932578:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388006.932583:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388006.932595:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388007.559846:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388007.768912:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388007.768956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388007.768983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388007.769019:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927872 00000100:00100000:3.0:1787388007.769027:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927872 00000100:00100000:3.0:1787388007.769082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927744 00000100:00100000:3.0:1787388007.769085:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927744 00000100:00100000:3.0:1787388007.769112:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 95 00000100:00100000:3.0:1787388007.769122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952927872:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388007.769195:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952927872:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388007.769210:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 95 00000100:00100000:3.0:1787388007.769230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 96 00000100:00100000:3.0:1787388007.769236:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952927744:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388007.769263:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952927744:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388007.769270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 96 00000100:00080000:3.0:1787388007.769299:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388007.769302:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388007.769532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952927616 00000100:00100000:0.0:1787388007.769538:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952927616 00000100:00100000:0.0:1787388007.769578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 280 00000100:00100000:0.0:1787388007.769586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952927616:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388007.769616:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952927616:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 32us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388007.769623:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 280 00000001:00100000:1.0:1787388007.947391:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:1.0:1787388007.947401:0:9516:0:(genops.c:906:class_export_put()) final put ffff9273fbf3e000/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:2.0:1787388007.947494:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf3e000/74df45bd-a066-4da5-9401-b0a043132784 for lustre-OST0001 00000020:00000080:2.0:1787388007.947549:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbf38000 for lustre-OST0001 00000001:00100000:2.0:1787388007.950122:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:2.0:1787388007.950131:0:8429:0:(genops.c:906:class_export_put()) final put ffff9272c2f66000/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:1.0:1787388007.950206:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2f66000/74df45bd-a066-4da5-9401-b0a043132784 for lustre-OST0000 00000020:00000080:1.0:1787388007.950260:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2f65000 for lustre-OST0000 00010000:00010000:0.0:1787388008.584787:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388009.608548:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388009.992910:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971869696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388009.992996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388009.993075:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388009.993083:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971869824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388009.993108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388009.993181:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869696 00000100:00100000:0.0:1787388009.993189:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869696 00000100:00100000:0.0:1787388009.993257:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869824 00000100:00100000:0.0:1787388009.993261:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869824 00000100:00100000:0.0:1787388009.993281:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787388009.993290:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971869696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388009.993322:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388009.993370:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971869696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388009.993377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787388009.993394:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787388009.993400:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971869824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388009.993411:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388009.993436:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971869824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388009.993442:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787388009.994913:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787388009.994967:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa87b80 x1874211971869824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388009.994989:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971869824:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787388009.995004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5ad80 x1874211971869696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388009.995015:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971869696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388010.506376:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971869952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388010.506459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388010.506554:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971869952 00000100:00100000:2.0:1787388010.506562:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971869952 00000100:00100000:2.0:1787388010.506611:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787388010.506620:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971869952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388010.506652:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388010.506722:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971869952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388010.506743:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787388010.506789:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971869952:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388010.641347:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388011.224087:0:11126:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.110 00010000:00010000:3.0:1787388011.657164:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388012.041297:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388012.041320:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971870080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388012.041397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388012.041466:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870080 00000100:00100000:0.0:1787388012.041474:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870080 00000100:00100000:0.0:1787388012.041517:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787388012.041526:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971870080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388012.041559:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388012.041605:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971870080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.041613:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787388012.041658:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971870080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388012.042103:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971870208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388012.042156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388012.042228:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870208 00000100:00100000:1.0:1787388012.042233:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870208 00000100:00100000:1.0:1787388012.042275:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787388012.042284:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971870208:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388012.042289:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971870336:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388012.042310:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388012.042325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388012.042354:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971870208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388012.042362:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787388012.042376:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5f800 x1874211971870208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388012.042378:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870336 00000100:00100000:1.0:1787388012.042384:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870336 00000100:00100000:2.0:1787388012.042398:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971870208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388012.042414:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388012.042422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971870336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388012.042434:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388012.042478:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971870336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388012.042485:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787388012.042523:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787388012.042553:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa87800 x1874211971870336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388012.042566:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971870336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388012.044578:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971870464:0@lo:400:kworker.0 00000100:00100000:2.0:1787388012.044641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388012.044755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870464 00000100:00100000:1.0:1787388012.044763:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870464 00000100:00100000:1.0:1787388012.044811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787388012.044820:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971870464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388012.045286:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971870464:12345-0@lo:400:kworker.0 Request processed in 466us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388012.045297:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971870464:0@lo:400:kworker.0 00000100:00100000:2.0:1787388012.045321:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388012.045328:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971870592:0@lo:400:kworker.0 00000100:00100000:2.0:1787388012.045355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388012.045367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787388012.045389:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870592 00000100:00100000:2.0:1787388012.045394:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870592 00000100:00100000:2.0:1787388012.045427:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787388012.045435:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971870592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388012.045472:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971870592:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388012.045478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787388012.045509:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971870592:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.051840:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971870848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.052054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388012.052102:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971871360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.052129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388012.052155:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787388012.052162:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971870720:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.052184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388012.052215:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971871232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.052236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388012.052268:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871360 00000100:00100000:3.0:1787388012.052276:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871360 00000100:00100000:0.0:1787388012.052286:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870848 00000100:00100000:0.0:1787388012.052304:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870848 00000100:00100000:3.0:1787388012.052324:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870720 00000100:00100000:3.0:1787388012.052329:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870720 00000100:00100000:0.0:1787388012.052345:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787388012.052349:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871232 00000100:00100000:3.0:1787388012.052353:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871232 00000100:00100000:0.0:1787388012.052358:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971870848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.052373:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388012.052381:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971871360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.052576:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971870848:12345-0@lo:400:kworker.0 Request processed in 221us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.052585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787388012.052839:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388012.052844:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388012.052860:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388012.052870:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971870720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.059459:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971870976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.060357:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971871360:12345-0@lo:400:kworker.0 Request processed in 7971us (8221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388012.060371:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388012.060407:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787388012.060421:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971871232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.062857:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971871232:12345-0@lo:400:kworker.0 Request processed in 56us (8233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.063720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388012.063764:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971871488:0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.063804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388012.063851:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971870976 00000100:00100000:0.0:1787388012.063860:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971870976 00000100:00100000:0.0:1787388012.063920:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787388012.063930:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971870976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.063987:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971870976:12345-0@lo:400:kworker.0 Request processed in 59us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.064006:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787388012.064047:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5ad80 x1874211971870976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388012.064060:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971870976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.064753:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787388012.064776:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871488 00000100:00100000:3.0:1787388012.064781:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871488 00000100:00100000:3.0:1787388012.064817:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787388012.064826:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.065047:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971871488:12345-0@lo:400:kworker.0 Request processed in 222us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388012.065054:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787388012.065097:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971870720:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.065111:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971871232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388012.065122:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971870848:0@lo:400:kworker.0 00010000:00080000:3.0:1787388012.065135:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b6680 x1874211971871360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388012.065146:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971871360:0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.065430:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971871488:0@lo:400:kworker.0 00000100:00100000:1.0:1787388012.065524:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971870720:12345-0@lo:400:kworker.0 Request processed in 7569us (8250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388012.065533:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1787388012.065555:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388012.065560:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388012.068071:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971871104:0@lo:400:kworker.0 00000100:00100000:2.0:1787388012.068145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388012.068208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971871616:0@lo:400:kworker.0 00000100:00100000:2.0:1787388012.068236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388012.068308:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871616 00000100:00100000:1.0:1787388012.068317:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871616 00000100:00100000:1.0:1787388012.068391:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388012.068401:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971871616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388012.068462:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971871616:12345-0@lo:400:kworker.0 Request processed in 63us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388012.068469:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1787388012.068786:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787388012.068816:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b5500 x1874211971871616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388012.068831:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971871616:0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.070661:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871104 00000100:00100000:0.0:1787388012.070674:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871104 00000100:00100000:0.0:1787388012.070764:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787388012.070775:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971871104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388012.070863:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971871104:12345-0@lo:400:kworker.0 Request processed in 90us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.070870:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787388012.070955:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b4700 x1874211971871104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388012.070971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971871104:0@lo:400:kworker.0 00000100:00080000:1.0:1787388012.071037:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787388012.679884:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388012.886578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388012.886628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388012.886664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388012.886830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928000 00000100:00100000:1.0:1787388012.886839:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928000 00000100:00100000:1.0:1787388012.886901:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 282 00000100:00100000:1.0:1787388012.886922:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952928000:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388012.886985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211952928000:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 65us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388012.886992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 282 00000100:00100000:2.0:1787388012.887114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928128 00000100:00100000:2.0:1787388012.887119:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928128 00000100:00100000:2.0:1787388012.887174:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928256 00000100:00100000:2.0:1787388012.887177:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928256 00000100:00100000:2.0:1787388012.887215:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 103 00000100:00100000:2.0:1787388012.887222:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952928128:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388012.887265:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952928128:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 44us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388012.887271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 103 00000100:00100000:2.0:1787388012.887285:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 104 00000100:00100000:2.0:1787388012.887291:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952928256:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388012.887313:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952928256:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388012.887319:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 104 00000100:00080000:1.0:1787388012.888583:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388012.888591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388013.709191:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388013.764511:0:11224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.110 00010000:00010000:2.0:1787388014.729202:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388015.111898:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388015.112569:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388015.112593:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971871872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388015.112671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388015.113438:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871872 00000100:00100000:0.0:1787388015.113448:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871872 00000100:00100000:0.0:1787388015.113533:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787388015.113539:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971871744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388015.113550:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971871872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388015.113580:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388015.113652:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971871872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388015.113657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388015.113666:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787388015.113704:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971871744 00000100:00100000:0.0:1787388015.113709:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971871744 00000100:00100000:0.0:1787388015.113733:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787388015.113778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388015.113816:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa86d80 x1874211971871872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388015.113834:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971871872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388015.114151:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971871744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388015.114167:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388015.114226:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971871744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 487us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388015.114232:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787388015.115272:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b7b80 x1874211971871744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388015.115292:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971871744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388015.624072:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971872000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388015.624146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388015.624310:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872000 00000100:00100000:1.0:1787388015.624318:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872000 00000100:00100000:1.0:1787388015.624366:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787388015.624375:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971872000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388015.624405:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388015.624448:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971872000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388015.624455:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787388015.624537:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971872000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388015.752168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787388016.248019:0:11321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.110 00010000:00010000:3.0:1787388016.775862:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388017.160017:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971872384:0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388017.160122:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872384 00000100:00100000:1.0:1787388017.160129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872384 00000100:00100000:0.0:1787388017.160155:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971872896:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160177:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787388017.160181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388017.160186:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971872384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160202:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971873408:0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160222:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388017.160240:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971872384:12345-0@lo:400:kworker.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388017.160247:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787388017.160256:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971872384:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160261:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873408 00000100:00100000:1.0:1787388017.160264:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873408 00000100:00100000:0.0:1787388017.160273:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787388017.160278:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971872512:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787388017.160296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971873408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388017.160318:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971873024:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160322:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971873408:12345-0@lo:400:kworker.0 Request processed in 27us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388017.160328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388017.160336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388017.160347:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388017.160352:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971873536:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160361:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872896 00000100:00100000:1.0:1787388017.160364:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872896 00000100:00100000:0.0:1787388017.160370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388017.160389:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873024 00000100:00100000:0.0:1787388017.160389:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971873408:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160391:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873024 00000100:00100000:1.0:1787388017.160409:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787388017.160413:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388017.160415:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971872896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160419:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971873024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.160449:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971872896:12345-0@lo:400:kworker.0 Request processed in 34us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.160451:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971873024:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388017.160455:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787388017.160458:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787388017.160472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388017.160472:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873536 00000100:00100000:0.0:1787388017.160475:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873536 00010000:00080000:1.0:1787388017.160489:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5f480 x1874211971873024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388017.160500:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971873024:0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160500:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787388017.160506:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971873536:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787388017.160510:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5f800 x1874211971872896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388017.160518:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971872896:0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160532:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971873536:12345-0@lo:400:kworker.0 Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.160538:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1787388017.160540:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7f480 x1874211971873536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388017.160548:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971873536:0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.160555:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872512 00000100:00100000:0.0:1787388017.160558:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872512 00000100:00080000:1.0:1787388017.160567:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388017.160580:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787388017.160676:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971872640:0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.160720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160752:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971873152:0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.160774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160789:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971873664:0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.160808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160825:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:2.0:1787388017.160831:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971872256:0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.160861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160881:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971872128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388017.160913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160929:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971872768:0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.160934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388017.160942:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971873920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388017.160947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160956:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.160966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388017.160986:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971873792:0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.161004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388017.161008:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873920 00000100:00100000:3.0:1787388017.161012:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873920 00000100:00100000:3.0:1787388017.161044:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787388017.161051:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971873920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388017.161076:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388017.161121:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971873920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.161128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787388017.161136:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787388017.161154:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c209ea00 x1874211971873920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388017.161154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872256 00000100:00100000:2.0:1787388017.161157:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872256 00000100:00100000:3.0:1787388017.161167:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971873920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388017.161181:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787388017.161187:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971872256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.161188:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872640 00000100:00100000:3.0:1787388017.161191:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872640 00000100:00100000:3.0:1787388017.161209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873152 00000100:00100000:3.0:1787388017.161212:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873152 00000100:00100000:2.0:1787388017.161220:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971872256:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.161227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873280 00000100:00100000:2.0:1787388017.161227:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787388017.161229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873280 00000100:00100000:3.0:1787388017.161240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787388017.161245:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971872640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.161274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971872640:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.161279:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971872256:0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.161280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787388017.161289:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971872640:0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.161291:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787388017.161297:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971873152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.161305:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388017.161312:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971874048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388017.161328:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971873152:12345-0@lo:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.161332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388017.161334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787388017.161352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787388017.161353:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874048 00000100:00100000:2.0:1787388017.161356:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874048 00000100:00100000:3.0:1787388017.161358:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971873280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388017.161376:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787388017.161382:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971874048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388017.161385:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971873280:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.161390:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00002000:00000024:2.0:1787388017.161391:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787388017.161404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388017.161407:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388017.161408:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787388017.161426:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5dc00 x1874211971873280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388017.161426:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971874048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.161432:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388017.161436:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.161445:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971873152:0@lo:400:kworker.0 00010000:00080000:2.0:1787388017.161454:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85500 x1874211971874048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388017.161465:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971874048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388017.161471:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872128 00000100:00100000:3.0:1787388017.161475:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872128 00000100:00100000:2.0:1787388017.161484:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873664 00000100:00100000:2.0:1787388017.161487:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873664 00000100:00100000:0.0:1787388017.161539:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971872512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.161579:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971872512:12345-0@lo:400:kworker.0 Request processed in 43us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388017.162442:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971872768 00000100:00100000:1.0:1787388017.162450:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971872768 00000100:00100000:1.0:1787388017.162477:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787388017.162485:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971872768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.162542:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971872768:12345-0@lo:400:kworker.0 Request processed in 58us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388017.162548:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787388017.162576:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971873792 00000100:00100000:1.0:1787388017.162579:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971873792 00000100:00100000:1.0:1787388017.162601:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388017.162607:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971873792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.162634:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971873792:12345-0@lo:400:kworker.0 Request processed in 27us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388017.162654:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388017.162706:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971872768:0@lo:400:kworker.0 00010000:00080000:1.0:1787388017.162718:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7d180 x1874211971873792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388017.162728:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971873792:0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.162769:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971872512:0@lo:400:kworker.0 00000100:00100000:3.0:1787388017.162931:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787388017.162940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971872128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388017.162962:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388017.163008:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971872128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.163014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388017.163191:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388017.163200:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388017.163202:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971872128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388017.163538:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971873664:12345-0@lo:400:kworker.0 Request processed in 339us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.163546:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787388017.163563:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7ce00 x1874211971873664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388017.163574:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971873664:0@lo:400:kworker.0 00000100:00100000:0.0:1787388017.168277:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1787388017.803947:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388018.018532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388018.018571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388018.018596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388018.018624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928512 00000100:00100000:0.0:1787388018.018634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928512 00000100:00100000:0.0:1787388018.018707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928640 00000100:00100000:0.0:1787388018.018710:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928640 00000100:00100000:0.0:1787388018.018732:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 111 00000100:00100000:0.0:1787388018.018740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952928512:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388018.018810:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952928512:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388018.018826:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 111 00000100:00100000:0.0:1787388018.018844:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 112 00000100:00100000:0.0:1787388018.018851:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952928640:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388018.018879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952928640:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388018.018885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 112 00000100:00100000:0.0:1787388018.018904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928384 00000100:00100000:0.0:1787388018.018907:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928384 00000100:00100000:0.0:1787388018.018935:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 284 00000100:00100000:0.0:1787388018.018941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2404:x1874211952928384:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388018.018965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2404:x1874211952928384:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388018.018971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 284 00000100:00080000:0.0:1787388018.019000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388018.019004:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787388018.190799:0:11369:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 04:40:16 EDT 2026 00010000:00010000:3.0:1787388018.823843:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388019.856750:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388020.231838:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388020.231863:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971874176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388020.231929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388020.231985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874176 00000100:00100000:0.0:1787388020.231992:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874176 00000100:00100000:0.0:1787388020.232060:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787388020.232070:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971874176:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388020.232084:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388020.232093:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971874304:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388020.232097:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388020.232120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388020.232135:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971874176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388020.232143:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388020.232144:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874304 00000100:00100000:1.0:1787388020.232147:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874304 00000100:00100000:1.0:1787388020.232171:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787388020.232178:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971874304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388020.232188:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388020.232217:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971874304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388020.232223:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787388020.232266:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787388020.232299:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b6a00 x1874211971874176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388020.232318:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971874176:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787388020.239222:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7ce00 x1874211971874304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388020.239264:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971874304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388020.749546:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388020.749570:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971874432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388020.749637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388020.749716:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874432 00000100:00100000:3.0:1787388020.749725:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874432 00000100:00100000:3.0:1787388020.749773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787388020.749782:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971874432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388020.749815:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388020.750085:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971874432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 303us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388020.750094:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787388020.750147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971874432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388020.873894:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388021.896823:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388022.280430:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388022.280431:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971874560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388022.280450:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971874688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388022.280511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388022.280512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388022.280670:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971874944:0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.281024:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971875200:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.281264:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971874816:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.281302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388022.281330:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971875328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.281354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388022.281372:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971875840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.281398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388022.281444:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874688 00000100:00100000:2.0:1787388022.281452:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874688 00000100:00100000:2.0:1787388022.281507:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787388022.281527:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971874688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388022.281554:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388022.281599:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971874688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388022.281605:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971875072:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.281608:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787388022.281640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388022.281672:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971875584:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.281721:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874816 00000100:00100000:2.0:1787388022.281726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874816 00000100:00100000:2.0:1787388022.281751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787388022.281757:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971874816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.285926:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971874816:12345-0@lo:400:kworker.0 Request processed in 4159us (4613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388022.285942:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787388022.285978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388022.286036:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971876096:0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.286066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388022.286118:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875328 00000100:00100000:1.0:1787388022.286127:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875328 00000100:00100000:1.0:1787388022.286166:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876096 00000100:00100000:1.0:1787388022.286180:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876096 00000100:00100000:3.0:1787388022.286280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388022.286305:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971875456:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.286334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388022.286361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388022.286540:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971875968:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.286562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787388022.286613:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388022.286617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388022.286801:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971875712:0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.286892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388022.286905:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971876224:0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.286928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388022.288234:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875456 00000100:00100000:2.0:1787388022.288245:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875456 00000100:00100000:1.0:1787388022.288254:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787388022.288267:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971875328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.288338:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971875328:12345-0@lo:400:kworker.0 Request processed in 75us (6982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388022.288380:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388022.288391:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971876096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.288465:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971876096:12345-0@lo:400:kworker.0 Request processed in 77us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.288521:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388022.288535:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876224 00000100:00100000:3.0:1787388022.288539:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876224 00000100:00100000:0.0:1787388022.288586:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971876352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388022.288621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388022.288674:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874560 00000100:00100000:0.0:1787388022.288706:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874560 00000100:00100000:0.0:1787388022.288735:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875200 00000100:00100000:0.0:1787388022.288739:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875200 00000100:00100000:0.0:1787388022.288754:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787388022.288760:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971874560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388022.288787:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388022.288840:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971874560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (8335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.288847:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787388022.288865:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787388022.288871:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971875200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.288905:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971875200:12345-0@lo:400:kworker.0 Request processed in 34us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.288921:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787388022.288941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875840 00000100:00100000:0.0:1787388022.288945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875840 00000100:00100000:0.0:1787388022.288964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875072 00000100:00100000:0.0:1787388022.288967:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875072 00000100:00100000:0.0:1787388022.288977:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875584 00000100:00100000:0.0:1787388022.288980:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875584 00000100:00100000:0.0:1787388022.288991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971874944 00000100:00100000:0.0:1787388022.288994:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971874944 00000100:00100000:0.0:1787388022.289021:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875968 00000100:00100000:0.0:1787388022.289024:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875968 00000100:00100000:0.0:1787388022.289036:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971875712 00000100:00100000:0.0:1787388022.289038:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971875712 00000100:00100000:0.0:1787388022.289051:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787388022.289057:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971875840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.289096:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971875840:12345-0@lo:400:kworker.0 Request processed in 39us (7698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.289102:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787388022.289114:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787388022.289119:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971875072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.289146:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971875072:12345-0@lo:400:kworker.0 Request processed in 27us (7506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.289152:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787388022.289163:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787388022.289178:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971875584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.289205:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971875584:12345-0@lo:400:kworker.0 Request processed in 37us (3230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.289211:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787388022.289235:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787388022.289241:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971874944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.289277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971874944:12345-0@lo:400:kworker.0 Request processed in 36us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.289283:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787388022.289294:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787388022.289299:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971875968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.289324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971875968:12345-0@lo:400:kworker.0 Request processed in 24us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.289329:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787388022.289339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787388022.289345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971875712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388022.289559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971875712:12345-0@lo:400:kworker.0 Request processed in 213us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388022.289565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787388022.289610:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971875200:0@lo:400:kworker.0 00010000:00080000:0.0:1787388022.289625:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4e00 x1874211971875712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388022.289636:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971875712:0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.291562:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388022.291574:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787388022.291604:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388022.291620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971875456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.291641:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876352 00000100:00100000:2.0:1787388022.291649:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876352 00000100:00100000:2.0:1787388022.291716:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787388022.291724:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971875456:12345-0@lo:400:kworker.0 Request processed in 111us (5387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388022.291726:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971876352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388022.291740:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00002000:00000024:2.0:1787388022.291748:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388022.291795:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971876352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388022.291803:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787388022.291857:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c361b100 x1874211971876352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388022.291860:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971874816:0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.291882:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971876352:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787388022.291884:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364d180 x1874211971875328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388022.291896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971875328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388022.291914:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971875840:0@lo:400:kworker.0 00000100:00080000:1.0:1787388022.291915:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388022.291923:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388022.291927:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388022.292627:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787388022.292640:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971876224:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787388022.293642:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85500 x1874211971874688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388022.293662:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971874688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388022.297048:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971875072:0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.297069:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971875584:0@lo:400:kworker.0 00010000:00080000:1.0:1787388022.297085:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d90e00 x1874211971876096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388022.297094:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971876096:0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.297135:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971874560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388022.299368:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971874944:0@lo:400:kworker.0 00010000:00080000:2.0:1787388022.299394:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7480 x1874211971875456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388022.299407:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971875456:0@lo:400:kworker.0 00010000:00080000:2.0:1787388022.299421:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d92300 x1874211971875968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388022.299431:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971875968:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.299608:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971876224:12345-0@lo:400:kworker.0 Request processed in 6970us (12676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.299619:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787388022.300299:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36c5c00 x1874211971876224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388022.300312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971876224:0@lo:400:kworker.0 00010000:00010000:3.0:1787388022.924783:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388023.127078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388023.127126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388023.127155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388023.127563:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929024 00000100:00100000:2.0:1787388023.127572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929024 00000100:00100000:2.0:1787388023.127632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928896 00000100:00100000:2.0:1787388023.127635:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928896 00000100:00100000:2.0:1787388023.127675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 119 00000100:00100000:2.0:1787388023.127702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952929024:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388023.127772:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952929024:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 73us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388023.127780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 119 00000100:00100000:2.0:1787388023.127798:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 120 00000100:00100000:2.0:1787388023.127805:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952928896:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388023.127829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952928896:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388023.127835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 120 00000100:00080000:2.0:1787388023.127852:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388023.127856:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388023.133661:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952928768 00000100:00100000:3.0:1787388023.133770:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952928768 00000100:00100000:2.0:1787388023.133976:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 286 00000100:00100000:2.0:1787388023.133998:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2401:x1874211952928768:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388023.134082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2401:x1874211952928768:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 87us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388023.134091:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 286 00010000:00010000:3.0:1787388023.943791:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388024.967940:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388025.351845:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971876480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388025.351920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388025.352006:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876480 00000100:00100000:3.0:1787388025.352015:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876480 00000100:00100000:3.0:1787388025.352072:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787388025.352083:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971876480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388025.352114:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388025.352157:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971876480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388025.352164:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787388025.352201:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787388025.352234:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3619880 x1874211971876480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388025.352252:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971876480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388025.353017:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388025.353042:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971876608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388025.353082:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388025.353113:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876608 00000100:00100000:3.0:1787388025.353118:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876608 00000100:00100000:3.0:1787388025.353150:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787388025.353157:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971876608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388025.353170:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388025.353313:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971876608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388025.353319:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787388025.353336:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787388025.353386:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3619880 x1874211971876608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388025.353401:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971876608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388025.866295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971876736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388025.866367:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388025.866668:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876736 00000100:00100000:0.0:1787388025.866697:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876736 00000100:00100000:0.0:1787388025.866759:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787388025.866768:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971876736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388025.866972:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388025.867024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971876736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 257us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388025.867032:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787388025.867077:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971876736:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388025.991961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388027.015812:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388027.400269:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971877248:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.400399:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971877760:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.400447:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971878272:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.400502:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787388027.400510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971876864:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388027.400563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876864 00000100:00100000:0.0:1787388027.400564:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971877376:0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.400570:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876864 00000100:00100000:0.0:1787388027.400586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.400606:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971877888:0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.400627:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787388027.400627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388027.400636:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971876864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400643:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971878400:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388027.400818:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971876864:12345-0@lo:400:kworker.0 Request processed in 183us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388027.400824:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971876864:0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.400827:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787388027.400859:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971876992:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.400894:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.400923:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971877504:0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.400926:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388027.400935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971878784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388027.400946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388027.400957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388027.400985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878784 00000100:00100000:3.0:1787388027.400989:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878784 00000100:00100000:2.0:1787388027.400994:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877248 00000100:00100000:2.0:1787388027.400997:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877248 00000100:00100000:2.0:1787388027.401015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877760 00000100:00100000:3.0:1787388027.401017:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388027.401018:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877760 00000100:00100000:3.0:1787388027.401023:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971878784:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388027.401030:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877888 00000100:00100000:2.0:1787388027.401032:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877888 00002000:00000024:3.0:1787388027.401043:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388027.401052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971876992 00000100:00100000:2.0:1787388027.401055:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971876992 00000100:00100000:2.0:1787388027.401067:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787388027.401072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971877248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.401094:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971878784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388027.401101:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388027.401102:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971877248:12345-0@lo:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.401108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1787388027.401116:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388027.401120:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388027.401120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787388027.401122:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388027.401126:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971877760:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787388027.401143:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbf100 x1874211971878784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388027.401149:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971877760:12345-0@lo:400:kworker.0 Request processed in 24us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.401154:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787388027.401159:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971878784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388027.401166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787388027.401171:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971877888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.401197:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971877888:12345-0@lo:400:kworker.0 Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.401203:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787388027.401213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787388027.401218:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971876992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.401242:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971876992:12345-0@lo:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.401247:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1787388027.401328:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364ca80 x1874211971877888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388027.401338:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971877888:0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.401358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971877248:0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.401368:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971877760:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.401548:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971878016:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.401572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.401597:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971878528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388027.401618:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.401647:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971876992:0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.401650:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878016 00000100:00100000:3.0:1787388027.401654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878016 00000100:00100000:0.0:1787388027.401658:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787388027.401664:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971877120:0@lo:400:kworker.0 00000100:00100000:3.0:1787388027.401706:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787388027.401713:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971878016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.401739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388027.401740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971878016:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388027.401746:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787388027.401756:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971877632:0@lo:400:kworker.0 00000100:00080000:3.0:1787388027.401759:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388027.401777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388027.402759:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877376 00000100:00100000:2.0:1787388027.402768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877376 00000100:00100000:2.0:1787388027.402800:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877120 00000100:00100000:2.0:1787388027.402803:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877120 00000100:00100000:2.0:1787388027.402818:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787388027.402825:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971877376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.402882:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971877376:12345-0@lo:400:kworker.0 Request processed in 57us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.402889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787388027.402915:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787388027.402921:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971877120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.402950:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971877120:12345-0@lo:400:kworker.0 Request processed in 30us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.402956:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787388027.403253:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878528 00000100:00100000:2.0:1787388027.403258:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878528 00000100:00100000:2.0:1787388027.403300:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388027.403306:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971878528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388027.403323:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388027.403354:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971878528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.403360:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388027.409017:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971878144:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.409084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.409104:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971878656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388027.409148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.409192:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971878016:0@lo:400:kworker.0 00010000:00080000:0.0:1787388027.409207:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d92300 x1874211971878528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388027.409225:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971878528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388027.409252:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971877120:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.409273:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878656 00000100:00100000:0.0:1787388027.409287:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878656 00000100:00100000:0.0:1787388027.409327:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787388027.409336:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971878656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388027.409381:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388027.409426:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971878656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388027.409432:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787388027.412855:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878272 00000100:00100000:1.0:1787388027.412872:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878272 00000100:00100000:1.0:1787388027.412945:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878400 00000100:00100000:1.0:1787388027.412949:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878400 00000100:00100000:1.0:1787388027.412963:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877504 00000100:00100000:1.0:1787388027.412966:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877504 00000100:00100000:1.0:1787388027.412981:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971877632 00000100:00100000:1.0:1787388027.412984:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971877632 00000100:00100000:1.0:1787388027.413005:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388027.413015:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971878272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.413099:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971878272:12345-0@lo:400:kworker.0 Request processed in 86us (12626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.413107:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388027.413125:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388027.413131:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971878400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.413158:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971878400:12345-0@lo:400:kworker.0 Request processed in 28us (12494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.413164:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388027.413175:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388027.413181:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971877504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.413209:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971877504:12345-0@lo:400:kworker.0 Request processed in 28us (12263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.413215:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388027.413226:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388027.413232:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971877632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.413277:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971877632:12345-0@lo:400:kworker.0 Request processed in 45us (11499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.413284:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388027.413761:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878144 00000100:00100000:1.0:1787388027.413767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878144 00000100:00100000:1.0:1787388027.413806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787388027.413812:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971878144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.413849:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971878144:12345-0@lo:400:kworker.0 Request processed in 37us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.413856:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1787388027.419004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc5880 x1874211971877632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388027.419026:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971877632:0@lo:400:kworker.0 00010000:00080000:1.0:1787388027.419042:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364d180 x1874211971878144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388027.419052:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971878144:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.419075:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971878656:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787388027.419089:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7480 x1874211971877504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388027.419098:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971877504:0@lo:400:kworker.0 00000100:00080000:2.0:1787388027.419273:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388027.419281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388027.419300:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388027.419334:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971877376:0@lo:400:kworker.0 00010000:00080000:2.0:1787388027.419350:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5d500 x1874211971878400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388027.419358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971878400:0@lo:400:kworker.0 00010000:00080000:2.0:1787388027.419373:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364f800 x1874211971878272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388027.419392:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971878272:0@lo:400:kworker.0 00010000:00010000:3.0:1787388028.040852:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388028.255530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388028.255630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388028.255662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388028.256309:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929152 00000100:00100000:0.0:1787388028.256319:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929152 00000100:00100000:0.0:1787388028.256370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 288 00000100:00100000:0.0:1787388028.256379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2401:x1874211952929152:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388028.256449:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2401:x1874211952929152:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 70us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388028.256458:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 288 00000100:00100000:1.0:1787388028.256503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929280 00000100:00100000:1.0:1787388028.256508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929280 00000100:00100000:1.0:1787388028.256547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929408 00000100:00100000:1.0:1787388028.256550:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929408 00000100:00100000:1.0:1787388028.256578:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 127 00000100:00100000:1.0:1787388028.256585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952929280:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388028.256669:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952929280:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 85us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388028.256676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 127 00000100:00100000:1.0:1787388028.256710:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:1.0:1787388028.256868:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952929408:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388028.256905:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952929408:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 189us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388028.256912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00080000:1.0:1787388028.256939:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388028.256943:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388029.065840:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388030.087864:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388030.471882:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388030.471911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971878912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388030.471988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388030.472065:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971878912 00000100:00100000:0.0:1787388030.472074:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971878912 00000100:00100000:0.0:1787388030.472138:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787388030.472147:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971878912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388030.472179:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388030.472223:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971878912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388030.472247:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787388030.472268:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787388030.472315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caad80 x1874211971878912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388030.472335:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971878912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388030.475551:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971879040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388030.475626:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388030.475703:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879040 00000100:00100000:2.0:1787388030.475714:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879040 00000100:00100000:2.0:1787388030.475779:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787388030.475788:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971879040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388030.475810:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787388030.475817:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388030.475881:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971879040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388030.475890:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787388030.475926:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caad80 x1874211971879040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388030.475945:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971879040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388030.983936:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388030.989116:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971879168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388030.989708:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388030.989776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879168 00000100:00100000:0.0:1787388030.989786:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879168 00000100:00100000:0.0:1787388030.989847:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787388030.989859:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971879168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388030.989898:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388030.989960:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971879168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388030.989967:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787388030.990229:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971879168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388031.112092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388032.137340:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388032.287814:0:11998:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:40:31 (1787388031) === 00000100:00100000:3.0:1787388032.519891:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971879424:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.519947:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971879552:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.519971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388032.520028:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971879296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388032.525024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.525106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971879936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.525153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.525180:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971880448:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.525221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879424 00000100:00100000:3.0:1787388032.525230:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879424 00000100:00100000:3.0:1787388032.525290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787388032.525315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971879424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.525379:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971879424:12345-0@lo:400:kworker.0 Request processed in 65us (5407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.525387:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787388032.525429:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879936 00000100:00100000:0.0:1787388032.525429:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971880064:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.525433:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879936 00000100:00100000:3.0:1787388032.525459:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787388032.525459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.525465:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971879936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.525476:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971880576:0@lo:400:kworker.0 00000100:00100000:1.0:1787388032.525720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.525884:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.525915:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971881088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388032.525946:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971879680:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.525970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.525996:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971880192:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.526058:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971880704:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.526132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879552 00000100:00100000:0.0:1787388032.526137:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879552 00000100:00100000:0.0:1787388032.526164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880576 00000100:00100000:0.0:1787388032.526167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880576 00000100:00100000:0.0:1787388032.526189:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880704 00000100:00100000:0.0:1787388032.526192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880704 00000100:00100000:0.0:1787388032.526207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787388032.526213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971879552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526256:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971879552:12345-0@lo:400:kworker.0 Request processed in 43us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.526276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787388032.526292:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787388032.526298:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971880576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971880576:12345-0@lo:400:kworker.0 Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.526345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787388032.526357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787388032.526363:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971880704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526391:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971880704:12345-0@lo:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.526392:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971879936:12345-0@lo:400:kworker.0 Request processed in 926us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.526397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787388032.526398:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787388032.526414:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879680 00000100:00100000:0.0:1787388032.526414:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880064 00000100:00100000:3.0:1787388032.526417:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879680 00000100:00100000:0.0:1787388032.526417:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880064 00000100:00100000:3.0:1787388032.526432:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787388032.526437:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971879680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526444:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880192 00000100:00100000:0.0:1787388032.526447:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880192 00000100:00100000:3.0:1787388032.526465:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971879680:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.526465:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787388032.526470:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971880064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.526471:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787388032.526500:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971880064:12345-0@lo:400:kworker.0 Request processed in 29us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.526506:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388032.526509:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388032.526516:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971880192:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787388032.526533:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388032.526537:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388032.526539:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388032.526543:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971880192:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.526549:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388032.526564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.526570:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971879680:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.526582:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971880960:0@lo:400:kworker.0 00010000:00080000:0.0:1787388032.526583:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3ca9880 x1874211971880192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.526593:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971880192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.526601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787388032.526602:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3ca8a80 x1874211971880704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.526610:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971880704:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526633:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880960 00000100:00100000:0.0:1787388032.526636:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880960 00000100:00100000:0.0:1787388032.526660:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787388032.526700:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971880960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.526759:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971879424:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.526932:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971880960:12345-0@lo:400:kworker.0 Request processed in 234us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.526939:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787388032.526957:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388032.526965:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880448 00000100:00100000:0.0:1787388032.526975:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880448 00000100:00100000:0.0:1787388032.527004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787388032.527010:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971880448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.527041:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971880448:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.527047:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1787388032.527062:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388032.527152:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971881216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388032.527180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388032.527974:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879296 00000100:00100000:2.0:1787388032.527982:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879296 00000100:00100000:2.0:1787388032.528408:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787388032.528418:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971879296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388032.528444:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388032.528496:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971879296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.528502:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787388032.528584:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388032.528866:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881216 00000100:00100000:2.0:1787388032.528874:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881216 00000100:00100000:2.0:1787388032.528976:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787388032.528985:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971881216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388032.529016:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388032.529075:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971881216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.529082:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787388032.529324:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971879936:0@lo:400:kworker.0 00000100:00100000:2.0:1787388032.529324:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971881216:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787388032.529341:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caaa00 x1874211971880448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388032.529352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971880448:0@lo:400:kworker.0 00010000:00080000:3.0:1787388032.529364:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3cabb80 x1874211971880960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388032.529373:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971880960:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.529586:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.529627:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971879552:0@lo:400:kworker.0 00010000:00080000:0.0:1787388032.529640:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3ca8000 x1874211971880064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.529649:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971880064:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.529661:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971880576:0@lo:400:kworker.0 00010000:00080000:0.0:1787388032.529915:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bd880 x1874211971879296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.529929:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971879296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388032.529939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971879808:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.529980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.530058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971880320:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.530080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.530132:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881088 00000100:00100000:3.0:1787388032.530137:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881088 00000100:00100000:3.0:1787388032.530182:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388032.530190:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971881088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388032.530206:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388032.530249:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971881088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.530257:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787388032.530289:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d93b80 x1874211971881088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388032.530302:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971881088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388032.530482:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971880832:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.530520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.530627:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880832 00000100:00100000:3.0:1787388032.530632:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880832 00000100:00100000:3.0:1787388032.530667:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787388032.530674:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971880832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.530727:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971880832:12345-0@lo:400:kworker.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.530741:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787388032.531563:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caa680 x1874211971880832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.531576:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971880832:0@lo:400:kworker.0 00000100:00100000:1.0:1787388032.532216:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971879808 00000100:00100000:1.0:1787388032.532224:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971879808 00000100:00100000:0.0:1787388032.532439:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971880320 00000100:00100000:0.0:1787388032.532444:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971880320 00000100:00100000:0.0:1787388032.532486:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787388032.532494:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971879808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.532558:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971879808:12345-0@lo:400:kworker.0 Request processed in 65us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.532564:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787388032.532578:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787388032.532584:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971880320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.532605:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971880320:12345-0@lo:400:kworker.0 Request processed in 21us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.532610:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787388032.532643:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971879808:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.532653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971880320:0@lo:400:kworker.0 00000100:00080000:3.0:1787388032.535725:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388032.756724:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.756832:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929536 00000100:00100000:0.0:1787388032.756842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929536 00000100:00100000:0.0:1787388032.756900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 290 00000100:00100000:0.0:1787388032.756910:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:8758:x1874211952929536:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787388032.756926:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388032.756946:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafac00/0x5cb77467b1811b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4bb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.756989:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafac00/0x5cb77467b1811b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bb6 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.757002:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafac00/0x5cb77467b1811b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bb6 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.757012:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafac00, rc 0) 00000100:00100000:0.0:1787388032.757091:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8758:x1874211952929536:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 182us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.757099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 290 00000100:00100000:0.0:1787388032.761641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388032.765961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929664 00000100:00100000:2.0:1787388032.765982:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929664 00000100:00100000:2.0:1787388032.766069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 291 00000100:00100000:2.0:1787388032.766080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8758:x1874211952929664:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787388032.766266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8758:x1874211952929664:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 187us (4633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.766274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 291 00000100:00100000:1.0:1787388032.768495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388032.768560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929792 00000100:00100000:3.0:1787388032.768569:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929792 00000100:00100000:3.0:1787388032.768616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 292 00000100:00100000:3.0:1787388032.768625:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8758:x1874211952929792:12345-192.168.204.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787388032.768785:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8758:x1874211952929792:12345-192.168.204.52@tcp:503:mount.lustre.0 Request processed in 161us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.768802:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 292 00000100:00100000:1.0:1787388032.772729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.775830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952929920 00000100:00100000:0.0:1787388032.775845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952929920 00000100:00100000:0.0:1787388032.775923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 293 00000100:00100000:0.0:1787388032.775933:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8762:x1874211952929920:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388032.776100:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8762:x1874211952929920:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 167us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.776108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 293 00000100:00100000:0.0:1787388032.805627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388032.805858:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930048 00000100:00100000:2.0:1787388032.805870:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930048 00000100:00100000:2.0:1787388032.805936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 294 00000100:00100000:2.0:1787388032.805947:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8762:x1874211952930048:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388032.806119:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8762:x1874211952930048:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 173us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.806128:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 294 00000100:00100000:1.0:1787388032.810245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388032.814193:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930176 00000100:00100000:3.0:1787388032.814212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930176 00000100:00100000:3.0:1787388032.814390:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 295 00000100:00100000:3.0:1787388032.814401:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8762:x1874211952930176:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388032.814899:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8762:x1874211952930176:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 499us (4663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.814909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 295 00000100:00100000:1.0:1787388032.829467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.829789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930304 00000100:00100000:0.0:1787388032.829809:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930304 00000100:00100000:0.0:1787388032.829922:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 296 00000100:00100000:0.0:1787388032.829932:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:8758:x1874211952930304:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787388032.829952:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388032.829972:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4be7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.830019:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4be7 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.830032:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4be7 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.830041:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafae00, rc 0) 00000100:00100000:0.0:1787388032.830109:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:8758:x1874211952930304:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 177us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.830116:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 296 00000100:00100000:0.0:1787388032.833875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388032.834031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930432 00000100:00100000:3.0:1787388032.834042:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930432 00000100:00100000:3.0:1787388032.834141:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 297 00000100:00100000:3.0:1787388032.834151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:8758:x1874211952930432:12345-192.168.204.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787388032.834177:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787388032.834200:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787388032.834204:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787388032.834207:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787388032.834210:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787388032.834212:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787388032.836057:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:8758:x1874211952930432:12345-192.168.204.52@tcp:256:mount.lustre.0 Request processed in 1896us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.836070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 297 00000100:00100000:1.0:1787388032.839305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.839389:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930560 00000100:00100000:0.0:1787388032.839398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930560 00000100:00100000:0.0:1787388032.839450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 298 00000100:00100000:0.0:1787388032.839458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:8758:x1874211952930560:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787388032.839473:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388032.839489:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4bee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.839515:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.839526:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388032.839549:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbe00, rc 0) 00000100:00100000:0.0:1787388032.839606:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8758:x1874211952930560:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 148us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.839614:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 298 00000100:00100000:2.0:1787388032.841872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.842025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930688 00000100:00100000:0.0:1787388032.842034:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930688 00000100:00100000:0.0:1787388032.842089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 299 00000100:00100000:0.0:1787388032.842098:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8758:x1874211952930688:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787388032.842246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8758:x1874211952930688:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 148us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.842255:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 299 00000100:00100000:3.0:1787388032.844421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388032.844586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930816 00000100:00100000:2.0:1787388032.844596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930816 00000100:00100000:2.0:1787388032.844802:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 300 00000100:00100000:2.0:1787388032.844814:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8758:x1874211952930816:12345-192.168.204.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787388032.845038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8758:x1874211952930816:12345-192.168.204.52@tcp:503:mount.lustre.0 Request processed in 226us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.845047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 300 00000100:00100000:1.0:1787388032.847186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.847508:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952930944 00000100:00100000:0.0:1787388032.847517:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952930944 00000100:00100000:0.0:1787388032.847605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 301 00000100:00100000:0.0:1787388032.847616:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8767:x1874211952930944:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388032.847818:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8767:x1874211952930944:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 203us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.847827:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 301 00000100:00100000:0.0:1787388032.850630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388032.850867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931072 00000100:00100000:2.0:1787388032.850946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931072 00000100:00100000:2.0:1787388032.851004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 302 00000100:00100000:2.0:1787388032.851014:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8767:x1874211952931072:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388032.851170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:8767:x1874211952931072:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 156us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.851179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 302 00000100:00100000:1.0:1787388032.860235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388032.860386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388032.865108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.866467:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931328 00000100:00100000:0.0:1787388032.866482:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931328 00000100:00100000:0.0:1787388032.866563:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931456 00000100:00100000:0.0:1787388032.866567:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931456 00000100:00100000:0.0:1787388032.866599:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:0.0:1787388032.866609:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952931328:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388032.866786:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952931328:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 178us (6560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.866805:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:0.0:1787388032.866823:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:0.0:1787388032.866830:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952931456:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388032.866855:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952931456:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 27us (6470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.866861:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:1.0:1787388032.869244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388032.869277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931200 00000100:00100000:1.0:1787388032.869285:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931200 00000100:00080000:3.0:1787388032.869472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388032.869478:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388032.869486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931712 00000100:00100000:1.0:1787388032.869489:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931712 00000100:00100000:1.0:1787388032.869502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:3.0:1787388032.869510:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:1.0:1787388032.869510:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874211952931200:12345-192.168.204.52@tcp:38:mount.lustre.0 00000100:00100000:3.0:1787388032.869515:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874211952931712:12345-192.168.204.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787388032.869540:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 55e2df5a-9363-4cf8-8d34-c496b357ff54@192.168.204.52@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:3.0:1787388032.869577:0:6520:0:(genops.c:1406:class_connect()) connect: client 55e2df5a-9363-4cf8-8d34-c496b357ff54, cookie 0x5cb77467b1811ba2 00000004:00100000:3.0:1787388032.869604:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 76 00010000:00080000:1.0:1787388032.869738:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 55e2df5a-9363-4cf8-8d34-c496b357ff54@192.168.204.52@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:1.0:1787388032.869763:0:6521:0:(genops.c:1406:class_connect()) connect: client 55e2df5a-9363-4cf8-8d34-c496b357ff54, cookie 0x5cb77467b1811ba9 00000004:00100000:1.0:1787388032.869776:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 76 00000100:00080000:3.0:1787388032.869813:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9273fbf21800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787388032.869845:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9272c23f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388032.870013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2400:x1874211952931712:12345-192.168.204.52@tcp:38:mount.lustre.0 Request processed in 495us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388032.870013:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2400:x1874211952931200:12345-192.168.204.52@tcp:38:mount.lustre.0 Request processed in 501us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.870021:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:1.0:1787388032.870024:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:0.0:1787388032.874080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.874167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.876435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388032.877515:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931584 00000100:00100000:2.0:1787388032.877528:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931584 00000100:00100000:2.0:1787388032.877620:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931840 00000100:00100000:2.0:1787388032.877624:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931840 00000100:00100000:2.0:1787388032.877658:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:2.0:1787388032.877668:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:0:x1874211952931584:12345-192.168.204.52@tcp:41:mount.lustre.0 00000100:00080000:1.0:1787388032.877824:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388032.877829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388032.877845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787388032.877855:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:0:x1874211952931840:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787388032.877890:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388032.877986:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:0:x1874211952931840:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 132us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388032.877993:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000004:00000024:2.0:1787388032.878215:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388032.878340:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:0:x1874211952931584:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 672us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.878347:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:3.0:1787388032.878904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952931968 00000100:00100000:3.0:1787388032.878913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952931968 00000100:00100000:1.0:1787388032.879170:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787388032.879181:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952931968:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787388032.879224:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388032.879389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952931968:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 211us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388032.879397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787388032.881851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388032.881981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932096 00000100:00100000:2.0:1787388032.881991:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932096 00000100:00100000:2.0:1787388032.882092:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:2.0:1787388032.882102:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952932096:12345-192.168.204.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787388032.882197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952932096:12345-192.168.204.52@tcp:40:mount.lustre.0 Request processed in 96us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.882205:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:0.0:1787388032.885136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.885183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388032.885226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388032.885340:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932480 00000100:00100000:3.0:1787388032.885351:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932480 00000100:00100000:3.0:1787388032.885411:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:3.0:1787388032.885421:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952932480:12345-192.168.204.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787388032.885498:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952932480:12345-192.168.204.52@tcp:900:mount.lustre.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.885507:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:2.0:1787388032.885902:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932224 00000100:00100000:2.0:1787388032.885908:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932224 00000100:00100000:2.0:1787388032.885943:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932352 00000100:00100000:2.0:1787388032.885947:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932352 00000100:00100000:1.0:1787388032.885956:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:1.0:1787388032.885963:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874211952932224:12345-192.168.204.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787388032.885996:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 55e2df5a-9363-4cf8-8d34-c496b357ff54@192.168.204.52@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:1.0:1787388032.886033:0:8437:0:(genops.c:1406:class_connect()) connect: client 55e2df5a-9363-4cf8-8d34-c496b357ff54, cookie 0x5cb77467b1811bb0 00002000:00100000:1.0:1787388032.886045:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55e2df5a-9363-4cf8-8d34-c496b357ff54/ffff9272c23f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787388032.886061:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 76 00002000:00080000:1.0:1787388032.886140:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787388032.886166:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9272c23f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388032.886199:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2400:x1874211952932224:12345-192.168.204.52@tcp:8:mount.lustre.0 Request processed in 236us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388032.888770:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:1.0:1787388032.888814:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787388032.888823:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874211952932352:12345-192.168.204.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787388032.888860:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 55e2df5a-9363-4cf8-8d34-c496b357ff54@192.168.204.52@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:1.0:1787388032.888907:0:8437:0:(genops.c:1406:class_connect()) connect: client 55e2df5a-9363-4cf8-8d34-c496b357ff54, cookie 0x5cb77467b1811bb7 00002000:00100000:1.0:1787388032.888923:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55e2df5a-9363-4cf8-8d34-c496b357ff54/ffff9272c23f3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787388032.888938:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 76 00002000:00080000:1.0:1787388032.889025:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787388032.889059:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9272c23f7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388032.889072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388032.889098:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932608 00000100:00100000:3.0:1787388032.889106:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932608 00000100:00100000:1.0:1787388032.889122:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2400:x1874211952932352:12345-192.168.204.52@tcp:8:mount.lustre.0 Request processed in 300us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388032.889129:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:3.0:1787388032.889142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:3.0:1787388032.889149:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952932608:12345-192.168.204.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787388032.889277:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787388032.889335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:8758:x1874211952932608:12345-192.168.204.52@tcp:33:mount.lustre.0 Request processed in 187us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.889341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 1 00010000:00010000:3.0:1787388033.160691:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388034.193870:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388035.216218:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388035.592574:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971881472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388035.592648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388035.592759:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388035.592767:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971881344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388035.592793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388035.592876:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881472 00000100:00100000:1.0:1787388035.592883:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881472 00000100:00100000:1.0:1787388035.592941:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881344 00000100:00100000:1.0:1787388035.592944:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881344 00000100:00100000:1.0:1787388035.592962:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388035.592970:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971881472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388035.592997:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388035.593043:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971881472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388035.593050:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388035.593068:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787388035.593073:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971881344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388035.593097:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388035.593118:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971881344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388035.593123:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787388035.593168:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa80700 x1874211971881344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388035.593188:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971881344:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787388035.593200:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7f100 x1874211971881472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388035.593221:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971881472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388035.593556:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388036.104323:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388036.104357:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971881600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388036.104421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388036.104484:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881600 00000100:00100000:2.0:1787388036.104491:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881600 00000100:00100000:2.0:1787388036.104536:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787388036.104555:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971881600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388036.104589:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388036.104633:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971881600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388036.104640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787388036.104711:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971881600:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388036.236986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388037.257003:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388037.641111:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388037.641136:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971881728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388037.641204:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388037.641276:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881728 00000100:00100000:0.0:1787388037.641284:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881728 00000100:00100000:0.0:1787388037.641351:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787388037.641361:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971881728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388037.641388:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388037.641431:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971881728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.641451:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787388037.641470:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787388037.641496:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa80a80 x1874211971881728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388037.641514:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971881728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388037.642423:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971882240:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642491:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971882752:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642529:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971883264:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642584:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787388037.642590:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971882112:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642614:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642628:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971882624:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642659:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971883136:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642745:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971881856:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642798:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971882368:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642834:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971882880:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642869:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787388037.642875:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971881984:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642905:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971882496:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642937:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971883008:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.642958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.642982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882240 00000100:00100000:2.0:1787388037.642989:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882240 00000100:00100000:2.0:1787388037.643017:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882752 00000100:00100000:2.0:1787388037.643021:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882752 00000100:00100000:2.0:1787388037.643040:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883136 00000100:00100000:2.0:1787388037.643044:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883136 00000100:00100000:2.0:1787388037.643065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882880 00000100:00100000:2.0:1787388037.643067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882880 00000100:00100000:2.0:1787388037.643078:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881984 00000100:00100000:2.0:1787388037.643080:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881984 00000100:00100000:2.0:1787388037.643089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883008 00000100:00100000:2.0:1787388037.643091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883008 00000100:00100000:2.0:1787388037.643105:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787388037.643112:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971882240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643154:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971882240:12345-0@lo:400:kworker.0 Request processed in 42us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643160:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787388037.643175:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388037.643181:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971882752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643205:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971882752:12345-0@lo:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643210:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388037.643220:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787388037.643226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971883136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643250:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971883136:12345-0@lo:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787388037.643266:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787388037.643272:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971882880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643299:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971882880:12345-0@lo:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787388037.643316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787388037.643330:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971881984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643360:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971881984:12345-0@lo:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643365:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787388037.643376:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787388037.643381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971883008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971883008:12345-0@lo:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643411:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787388037.643430:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882112 00000100:00100000:2.0:1787388037.643433:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882112 00000100:00100000:2.0:1787388037.643453:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882368 00000100:00100000:2.0:1787388037.643456:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882368 00000100:00100000:2.0:1787388037.643467:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787388037.643473:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971882112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643503:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971882112:12345-0@lo:400:kworker.0 Request processed in 30us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643509:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787388037.643520:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787388037.643526:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f6a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971882368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643551:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f6a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971882368:12345-0@lo:400:kworker.0 Request processed in 25us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643556:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787388037.643826:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883264 00000100:00100000:2.0:1787388037.643830:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883264 00000100:00100000:2.0:1787388037.643856:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882624 00000100:00100000:2.0:1787388037.643860:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882624 00000100:00100000:2.0:1787388037.643881:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971882496 00000100:00100000:2.0:1787388037.643885:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971882496 00000100:00100000:2.0:1787388037.643898:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388037.643904:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971883264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643936:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971883264:12345-0@lo:400:kworker.0 Request processed in 32us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643943:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388037.643954:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388037.643959:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971882624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.643984:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971882624:12345-0@lo:400:kworker.0 Request processed in 25us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.643990:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388037.644000:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388037.644007:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971882496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644033:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971882496:12345-0@lo:400:kworker.0 Request processed in 27us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.644039:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388037.644057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971881856 00000100:00100000:2.0:1787388037.644060:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971881856 00000100:00100000:2.0:1787388037.644084:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787388037.644090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644117:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971881856:12345-0@lo:400:kworker.0 Request processed in 27us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.644122:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:2.0:1787388037.644153:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388037.644157:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388037.644159:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388037.644168:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388037.644199:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971882112:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.644213:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4e00 x1874211971882624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.644223:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971882624:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.644232:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364d500 x1874211971883136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.644241:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971883136:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644252:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971882240:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644262:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971882752:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.644272:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364ca80 x1874211971883264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.644280:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971883264:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644319:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971881984:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.644329:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc5880 x1874211971882496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.644337:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971882496:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644347:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971883008:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644356:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971881856:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.644365:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971882368:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.644374:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364f800 x1874211971882880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.644390:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971882880:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.648203:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388037.648231:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971883392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388037.648358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.648409:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883392 00000100:00100000:3.0:1787388037.648419:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883392 00000100:00100000:3.0:1787388037.648467:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388037.648476:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971883392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388037.648513:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388037.648561:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971883392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.648568:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388037.648622:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971883392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388037.652856:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388037.652882:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971883520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388037.652948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388037.655767:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883520 00000100:00100000:1.0:1787388037.655780:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883520 00000100:00100000:1.0:1787388037.655878:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787388037.655889:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971883520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388037.655914:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388037.656003:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971883520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388037.656011:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787388037.656086:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7f100 x1874211971883520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388037.656121:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971883520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388037.976498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388037.976717:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932992 00000100:00100000:0.0:1787388037.976726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932992 00000100:00100000:0.0:1787388037.976779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933248 00000100:00100000:0.0:1787388037.976782:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933248 00000100:00100000:0.0:1787388037.976795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932864 00000100:00100000:0.0:1787388037.976797:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932864 00000100:00100000:0.0:1787388037.976809:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933120 00000100:00100000:0.0:1787388037.976811:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933120 00000100:00100000:0.0:1787388037.976826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 143 00000100:00100000:0.0:1787388037.976835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952932992:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388037.976911:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952932992:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 76us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.976933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 143 00000100:00100000:0.0:1787388037.976951:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 144 00000100:00100000:0.0:1787388037.976958:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933248:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388037.976985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933248:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.976991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 144 00000100:00100000:0.0:1787388037.977003:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:0.0:1787388037.977009:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952932864:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388037.977031:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952932864:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.977037:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:0.0:1787388037.977046:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00100000:0.0:1787388037.977052:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933120:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388037.977073:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933120:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 21us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.977078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00100000:0.0:1787388037.977095:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933504 00000100:00100000:0.0:1787388037.977098:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933504 00000100:00100000:0.0:1787388037.977123:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933376 00000100:00100000:0.0:1787388037.977126:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933376 00000100:00100000:0.0:1787388037.977146:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:0.0:1787388037.977152:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933504:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388037.977175:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933504:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.977188:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:0.0:1787388037.977200:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:0.0:1787388037.977206:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933376:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388037.977230:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211952933376:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.977236:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00080000:0.0:1787388037.977262:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388037.977266:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388037.977269:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388037.977271:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388037.977956:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952932736 00000100:00100000:3.0:1787388037.977964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952932736 00000100:00100000:3.0:1787388037.978015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 304 00000100:00100000:3.0:1787388037.978023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952932736:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388037.978064:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952932736:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 41us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.978069:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 304 00010000:00010000:1.0:1787388038.280220:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388038.399208:0:12191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1787388039.182558:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000001:00100000:1.0:1787388039.183056:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000001:00100000:1.0:1787388039.186984:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000001:00100000:0.0:1787388039.187807:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00010000:00010000:3.0:1787388039.308062:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388040.328540:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388040.715009:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971883648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388040.715083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388040.715207:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883648 00000100:00100000:1.0:1787388040.715214:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883648 00000100:00100000:1.0:1787388040.715275:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787388040.715285:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971883648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388040.715322:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388040.715371:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971883648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388040.715379:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787388040.715441:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388040.715474:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7f800 x1874211971883648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388040.715492:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971883648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388040.715761:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388040.715769:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971883776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388040.715796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388040.715829:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883776 00000100:00100000:2.0:1787388040.715833:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883776 00000100:00100000:2.0:1787388040.715869:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787388040.715876:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971883776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388040.715888:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388040.715919:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971883776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388040.715924:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787388040.715940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388040.715959:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5f80 x1874211971883776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388040.715971:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971883776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388041.226183:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971883904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388041.226254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388041.226374:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971883904 00000100:00100000:2.0:1787388041.226383:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971883904 00000100:00100000:2.0:1787388041.226468:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787388041.226478:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971883904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388041.226523:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388041.226588:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971883904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388041.226595:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787388041.226918:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971883904:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388041.354814:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388042.383939:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388042.759843:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388042.759867:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971884032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388042.759942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388042.760008:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884032 00000100:00100000:3.0:1787388042.760016:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884032 00000100:00100000:3.0:1787388042.760062:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388042.760071:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971884032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388042.760105:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388042.760143:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971884032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.760157:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388042.760200:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971884032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388042.760303:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388042.760312:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971884160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388042.760347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.760384:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884160 00000100:00100000:1.0:1787388042.760388:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884160 00000100:00100000:1.0:1787388042.760440:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787388042.760450:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273efdb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971884160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388042.760471:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388042.760505:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273efdb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971884160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.760511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971884544:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.760514:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787388042.760557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760585:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971885056:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.760624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760647:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971885568:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.760676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760740:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787388042.760749:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971884416:0@lo:400:kworker.0 00000100:00080000:1.0:1787388042.760774:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388042.760780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760803:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971884928:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.760808:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971884288:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.760834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.760853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760859:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971885440:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.760881:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971884800:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.760899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.760912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760933:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884544 00000100:00100000:1.0:1787388042.760938:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971885312:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.760939:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884544 00000100:00100000:1.0:1787388042.760965:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.760971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885056 00000100:00100000:2.0:1787388042.760975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885056 00010000:00080000:1.0:1787388042.760987:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7ed80 x1874211971884160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388042.760999:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884416 00000100:00100000:2.0:1787388042.761003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884416 00000100:00100000:1.0:1787388042.761004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971884160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388042.761020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885440 00000100:00100000:1.0:1787388042.761030:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787388042.761031:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885440 00000100:00100000:1.0:1787388042.761042:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971884672:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.761053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885312 00000100:00100000:2.0:1787388042.761057:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885312 00000100:00100000:1.0:1787388042.761071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.761078:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787388042.761086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.761094:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971885184:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.761176:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884672 00000100:00100000:3.0:1787388042.761181:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884672 00000100:00100000:3.0:1787388042.761206:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787388042.761212:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971884672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.761836:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885568 00000100:00100000:0.0:1787388042.761842:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885568 00000100:00100000:0.0:1787388042.761886:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884928 00000100:00100000:0.0:1787388042.761890:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884928 00000100:00100000:0.0:1787388042.761903:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884800 00000100:00100000:0.0:1787388042.761906:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884800 00000100:00100000:0.0:1787388042.761921:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787388042.761928:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971885568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.762022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.762040:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388042.762052:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971885696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388042.762087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.762113:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885696 00000100:00100000:1.0:1787388042.762117:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885696 00000100:00100000:1.0:1787388042.762142:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388042.762148:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971885696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388042.762161:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388042.762194:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971885696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388042.762201:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787388042.762230:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388042.762233:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388042.762236:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388042.762238:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787388042.762261:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caa680 x1874211971885696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.762279:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971885696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388042.762317:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787388042.762325:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971884928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.762362:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971884928:12345-0@lo:400:kworker.0 Request processed in 37us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388042.762379:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787388042.762392:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388042.762399:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971884800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.762432:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971884800:12345-0@lo:400:kworker.0 Request processed in 34us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388042.762437:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388042.762452:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971884288 00000100:00100000:1.0:1787388042.762456:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971884288 00000100:00100000:1.0:1787388042.762480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787388042.762486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3645:x1874211971884288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.762515:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3645:x1874211971884288:12345-0@lo:400:kworker.0 Request processed in 30us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388042.762520:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:1.0:1787388042.762554:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfc000 x1874211971884928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.762564:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971884928:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.762588:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971884288:0@lo:400:kworker.0 00010000:00080000:1.0:1787388042.765326:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfed80 x1874211971884800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.765346:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971884800:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.765711:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971884672:12345-0@lo:400:kworker.0 Request processed in 4495us (4637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.765725:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388042.766891:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971884672:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.771350:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885184 00000100:00100000:3.0:1787388042.771365:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885184 00000100:00100000:2.0:1787388042.771368:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971884544:12345-0@lo:400:kworker.0 Request processed in 10276us (10806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.771381:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787388042.771413:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388042.771421:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787388042.771426:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971885056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.771433:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971884416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.771492:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971884416:12345-0@lo:400:kworker.0 Request processed in 62us (10714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.771499:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787388042.771514:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787388042.771521:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971885440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.771549:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971885440:12345-0@lo:400:kworker.0 Request processed in 30us (10650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.771555:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787388042.771566:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787388042.771573:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971885312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.771621:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971885312:12345-0@lo:400:kworker.0 Request processed in 49us (10656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.771646:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787388042.771659:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388042.771665:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971885184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.771714:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971885184:12345-0@lo:400:kworker.0 Request processed in 49us (9692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.771720:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1787388042.771831:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388042.771868:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971884416:0@lo:400:kworker.0 00010000:00080000:1.0:1787388042.771894:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd3100 x1874211971885440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.771905:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971885440:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.771916:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971884544:0@lo:400:kworker.0 00010000:00080000:1.0:1787388042.771960:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfdf80 x1874211971885184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.771968:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971885184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.771978:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971885312:0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.772017:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971885568:12345-0@lo:400:kworker.0 Request processed in 10086us (11338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388042.772029:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787388042.772035:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd2300 x1874211971885568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.772047:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971885568:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.774194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971885056:12345-0@lo:400:kworker.0 Request processed in 2762us (13560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.774210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787388042.778007:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971885056:0@lo:400:kworker.0 00000100:00100000:0.0:1787388043.099097:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099167:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099192:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099221:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099262:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388043.099291:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933888 00000100:00100000:0.0:1787388043.099300:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933888 00000100:00100000:0.0:1787388043.099347:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934144 00000100:00100000:0.0:1787388043.099351:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934144 00000100:00100000:0.0:1787388043.099366:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933760 00000100:00100000:0.0:1787388043.099367:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933760 00000100:00100000:0.0:1787388043.099378:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934016 00000100:00100000:0.0:1787388043.099380:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934016 00000100:00100000:0.0:1787388043.099395:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 153 00000100:00100000:0.0:1787388043.099404:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2402:x1874211952933888:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388043.099486:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2402:x1874211952933888:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 82us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388043.099493:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 153 00000100:00100000:0.0:1787388043.099512:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 154 00000100:00100000:0.0:1787388043.099518:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934144:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388043.099543:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934144:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388043.099549:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 154 00000100:00100000:0.0:1787388043.099561:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 155 00000100:00100000:0.0:1787388043.099567:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952933760:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388043.099605:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952933760:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388043.099612:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 155 00000100:00100000:0.0:1787388043.099632:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 156 00000100:00100000:0.0:1787388043.099638:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934016:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388043.099662:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934016:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388043.099668:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 156 00000100:00100000:2.0:1787388043.099791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952933632 00000100:00100000:2.0:1787388043.099796:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952933632 00000100:00100000:2.0:1787388043.099824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 306 00000100:00100000:2.0:1787388043.099830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2402:x1874211952933632:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388043.099855:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2402:x1874211952933632:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388043.099861:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 306 00000100:00100000:1.0:1787388043.100041:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934400 00000100:00100000:1.0:1787388043.100047:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934400 00000100:00100000:1.0:1787388043.100087:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934272 00000100:00100000:1.0:1787388043.100091:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934272 00000100:00100000:1.0:1787388043.100115:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:1.0:1787388043.100122:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934400:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388043.100150:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934400:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 29us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388043.100156:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:1.0:1787388043.100166:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:1.0:1787388043.100171:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934272:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388043.100199:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952934272:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 28us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388043.100205:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00080000:1.0:1787388043.100221:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388043.100225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388043.100228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388043.100230:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787388043.400072:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388044.423870:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388045.447922:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388045.480218:0:12508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388045.480497:0:12508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787388045.832654:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388045.832703:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971885952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388045.832811:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971885824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388045.833087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388045.833108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388045.833174:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885952 00000100:00100000:0.0:1787388045.833174:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971885824 00000100:00100000:3.0:1787388045.833182:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885952 00000100:00100000:0.0:1787388045.833182:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971885824 00000100:00100000:0.0:1787388045.833395:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787388045.833404:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971885824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388045.833435:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388045.833484:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971885824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388045.833492:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1787388045.833724:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7f100 x1874211971885824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388045.833741:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971885824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388045.835777:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787388045.835791:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971885952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388045.835815:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388045.835892:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971885952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388045.835899:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787388045.835982:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388045.836026:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd2300 x1874211971885952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388045.836049:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971885952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388046.344236:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971886080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388046.344332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388046.346021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886080 00000100:00100000:3.0:1787388046.346039:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886080 00000100:00100000:3.0:1787388046.346110:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787388046.346121:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971886080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388046.346169:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388046.346254:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971886080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388046.346262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787388046.346727:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971886080:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388046.475741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388047.471019:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388047.471467:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787388047.502224:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388047.881000:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971886208:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.881089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881157:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971886720:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.881185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881205:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388047.881212:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971886336:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.881236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881266:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886336 00000100:00100000:0.0:1787388047.881273:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886336 00000100:00100000:0.0:1787388047.881515:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787388047.881526:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971886336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.881581:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971886336:12345-0@lo:400:kworker.0 Request processed in 57us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388047.881587:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787388047.881624:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971886336:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.881716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971886464:0@lo:400:kworker.0 00000100:00100000:1.0:1787388047.881718:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388047.881746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881766:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388047.881786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388047.881801:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971886848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388047.881832:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881884:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787388047.881892:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971886592:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.881919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881937:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971887104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388047.881956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.881982:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886976 00000100:00100000:0.0:1787388047.881987:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886976 00000100:00100000:3.0:1787388047.882059:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971887360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.882119:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971887872:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.882160:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787388047.882165:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.882203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971887744:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.882245:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971887616:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.882283:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388047.882288:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971887488:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.882328:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886208 00000100:00100000:3.0:1787388047.882333:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886208 00000100:00100000:3.0:1787388047.882382:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787388047.882390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971886208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882423:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971886208:12345-0@lo:400:kworker.0 Request processed in 35us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.882429:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787388047.882470:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886720 00000100:00100000:3.0:1787388047.882474:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886720 00000100:00100000:3.0:1787388047.882492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886464 00000100:00100000:3.0:1787388047.882505:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886464 00000100:00100000:3.0:1787388047.882519:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886848 00000100:00100000:3.0:1787388047.882522:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886848 00000100:00100000:3.0:1787388047.882534:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787388047.882540:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971886720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882583:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971886720:12345-0@lo:400:kworker.0 Request processed in 43us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.882590:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787388047.882602:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787388047.882608:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971886464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.882649:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971886464:12345-0@lo:400:kworker.0 Request processed in 41us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.882655:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787388047.882667:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787388047.882673:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971886848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388047.882720:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388047.882749:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971886848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.882755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787388047.882776:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887104 00000100:00100000:3.0:1787388047.882779:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887104 00000100:00100000:3.0:1787388047.882813:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787388047.882821:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971887104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388047.882841:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388047.882871:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971887104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.882877:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787388047.882897:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887360 00000100:00100000:3.0:1787388047.882900:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887360 00000100:00100000:3.0:1787388047.882926:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887232 00000100:00100000:3.0:1787388047.882929:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887232 00000100:00100000:3.0:1787388047.882963:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787388047.882968:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971887360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883006:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971887360:12345-0@lo:400:kworker.0 Request processed in 38us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883013:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787388047.883025:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787388047.883031:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971887232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883057:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971887232:12345-0@lo:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883063:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787388047.883077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971886592 00000100:00100000:3.0:1787388047.883081:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971886592 00000100:00100000:3.0:1787388047.883097:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887872 00000100:00100000:3.0:1787388047.883100:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887872 00000100:00100000:3.0:1787388047.883110:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887744 00000100:00100000:3.0:1787388047.883113:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887744 00000100:00100000:3.0:1787388047.883123:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887616 00000100:00100000:3.0:1787388047.883125:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887616 00000100:00100000:3.0:1787388047.883137:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971887488 00000100:00100000:3.0:1787388047.883140:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971887488 00000100:00100000:3.0:1787388047.883152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787388047.883158:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971886592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883188:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971886592:12345-0@lo:400:kworker.0 Request processed in 30us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883194:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787388047.883204:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787388047.883211:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971887872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971887872:12345-0@lo:400:kworker.0 Request processed in 25us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883247:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787388047.883258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787388047.883263:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971887744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883298:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971887744:12345-0@lo:400:kworker.0 Request processed in 34us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787388047.883314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787388047.883321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971887616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971887616:12345-0@lo:400:kworker.0 Request processed in 29us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883356:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787388047.883367:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787388047.883372:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971887488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883399:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971887488:12345-0@lo:400:kworker.0 Request processed in 26us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.883406:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00080000:3.0:1787388047.883451:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbea00 x1874211971887232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388047.883465:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883477:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971887744:0@lo:400:kworker.0 00010000:00080000:3.0:1787388047.883486:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbc000 x1874211971887360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388047.883507:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971887360:0@lo:400:kworker.0 00010000:00080000:3.0:1787388047.883539:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbf480 x1874211971887872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388047.883548:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971887872:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883586:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971887488:0@lo:400:kworker.0 00010000:00080000:3.0:1787388047.883597:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbd880 x1874211971887616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388047.883607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971887616:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883648:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971886592:0@lo:400:kworker.0 00000100:00100000:1.0:1787388047.883666:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971886848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388047.883666:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1787388047.883668:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa7e300 x1874211971887104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388047.883697:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971886976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388047.883703:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971886720:0@lo:400:kworker.0 00002000:00000024:0.0:1787388047.883714:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388047.883720:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971887104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388047.883722:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971886208:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.883742:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971886464:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.883757:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971886976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1967us total) trans 0 rc 0/0 00010000:00080000:3.0:1787388047.883764:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caa680 x1874211971886976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388047.883768:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787388047.883782:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971886976:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787388047.883797:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388047.884070:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388047.884073:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388047.884076:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388048.213704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388048.213752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388048.214038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934656 00000100:00100000:3.0:1787388048.214048:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934656 00000100:00100000:3.0:1787388048.214116:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934912 00000100:00100000:3.0:1787388048.214120:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934912 00000100:00100000:3.0:1787388048.214147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 163 00000100:00100000:3.0:1787388048.214157:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952934656:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388048.214239:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952934656:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 83us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388048.214259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 163 00000100:00100000:3.0:1787388048.214278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 164 00000100:00100000:3.0:1787388048.214285:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952934912:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388048.214313:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952934912:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388048.214319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 164 00000100:00080000:0.0:1787388048.214942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388048.217838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388048.217889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388048.217928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388048.217955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388048.217984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388048.218009:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934784 00000100:00100000:1.0:1787388048.218018:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934784 00000100:00100000:1.0:1787388048.218074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935040 00000100:00100000:1.0:1787388048.218078:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935040 00000100:00100000:1.0:1787388048.218113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 165 00000100:00100000:1.0:1787388048.218124:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952934784:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388048.218193:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952934784:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388048.218201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 165 00000100:00100000:1.0:1787388048.218218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 166 00000100:00100000:1.0:1787388048.218226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952935040:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388048.218349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952934528 00000100:00100000:0.0:1787388048.218354:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952934528 00000100:00100000:0.0:1787388048.218386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 308 00000100:00100000:0.0:1787388048.218394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952934528:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388048.218462:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935168 00000100:00100000:3.0:1787388048.218466:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935168 00000100:00100000:3.0:1787388048.218511:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935296 00000100:00100000:3.0:1787388048.218516:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935296 00000100:00100000:3.0:1787388048.218540:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:3.0:1787388048.218548:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952935168:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388048.218662:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952935040:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 436us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388048.218670:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 166 00000100:00080000:1.0:1787388048.218722:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388048.218726:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388048.218729:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388048.218794:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952934528:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 400us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388048.218801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 308 00000100:00100000:3.0:1787388048.219193:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952935168:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 645us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388048.219202:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:3.0:1787388048.219221:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:3.0:1787388048.219229:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952935296:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388048.219338:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952935296:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 109us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388048.219345:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 68 00010000:00010000:0.0:1787388048.525337:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787388049.519580:0:12704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388049.520255:0:12704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787388049.547327:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388050.567898:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388050.951852:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971888000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388050.951953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388050.954392:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971888128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388050.954481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.966283:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888000 00000100:00100000:2.0:1787388050.966299:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888000 00000100:00100000:2.0:1787388050.966386:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888128 00000100:00100000:2.0:1787388050.966390:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888128 00000100:00100000:2.0:1787388050.966415:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787388050.966424:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971888000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388050.966469:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388050.966746:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787388050.966765:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971888128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388050.966776:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388050.966828:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971888128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (12347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388050.966835:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1787388050.966886:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bc380 x1874211971888128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388050.966917:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971888128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787388050.967240:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388050.967330:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971888000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 907us (15378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388050.967338:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1787388050.967458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd2300 x1874211971888000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388050.967473:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971888000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388051.464200:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388051.464229:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971888256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388051.464302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388051.464480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888256 00000100:00100000:3.0:1787388051.464488:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888256 00000100:00100000:3.0:1787388051.464544:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787388051.464554:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971888256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388051.464589:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388051.464644:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971888256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388051.464652:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787388051.464767:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971888256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787388051.592847:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787388051.684770:0:12801:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388051.685018:0:12801:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388052.616492:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388052.999896:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388052.999919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971888384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388052.999993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388053.000174:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888384 00000100:00100000:1.0:1787388053.000182:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888384 00000100:00100000:1.0:1787388053.000232:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787388053.000241:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971888384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388053.000278:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388053.000330:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971888384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.000337:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787388053.000419:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971888384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388053.000838:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971888512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388053.000890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.001407:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888512 00000100:00100000:0.0:1787388053.001414:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888512 00000100:00100000:0.0:1787388053.001483:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787388053.001492:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971888512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388053.001519:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388053.001568:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971888512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.001575:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787388053.001824:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971888896:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.001947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971888640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388053.001978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002000:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971889152:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002055:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971889664:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002101:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787388053.002106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971889024:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002143:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971889536:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002179:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971890048:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002226:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888640 00000100:00100000:0.0:1787388053.002231:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888640 00000100:00100000:0.0:1787388053.002260:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787388053.002267:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971888640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388053.002281:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388053.002315:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971888640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.002328:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787388053.002349:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889152 00000100:00100000:0.0:1787388053.002353:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889152 00000100:00100000:0.0:1787388053.002375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388053.002381:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971889152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002427:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971889152:12345-0@lo:400:kworker.0 Request processed in 45us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.002433:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1787388053.002471:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bfb80 x1874211971888640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388053.002488:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971888640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388053.002500:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971889152:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002545:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889664 00000100:00100000:0.0:1787388053.002548:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889664 00000100:00100000:0.0:1787388053.002577:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889024 00000100:00100000:0.0:1787388053.002580:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889024 00000100:00100000:0.0:1787388053.002592:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889536 00000100:00100000:0.0:1787388053.002594:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889536 00000100:00100000:0.0:1787388053.002608:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787388053.002615:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971889664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002652:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971889664:12345-0@lo:400:kworker.0 Request processed in 37us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.002658:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787388053.002671:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787388053.002706:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971889024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002746:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971889024:12345-0@lo:400:kworker.0 Request processed in 70us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.002753:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787388053.002766:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787388053.002773:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971889536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002801:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971889536:12345-0@lo:400:kworker.0 Request processed in 29us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.002806:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787388053.002830:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971888768:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002876:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002903:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971889280:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002924:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002938:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971889792:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.002958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388053.002982:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889792 00000100:00100000:0.0:1787388053.002986:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889792 00000100:00100000:0.0:1787388053.003009:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787388053.003015:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971889792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.003046:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971889792:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.003052:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787388053.003081:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971889024:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.003091:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971889536:0@lo:400:kworker.0 00010000:00080000:0.0:1787388053.003101:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfed80 x1874211971889664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388053.003118:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971889664:0@lo:400:kworker.0 00000100:00100000:0.0:1787388053.003150:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971889792:0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.003530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388053.003553:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971889408:0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.003578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388053.003597:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971889920:0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.003619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388053.003652:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890048 00000100:00100000:1.0:1787388053.003657:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890048 00000100:00100000:1.0:1787388053.003699:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889280 00000100:00100000:1.0:1787388053.003703:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889280 00000100:00100000:1.0:1787388053.003718:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889408 00000100:00100000:1.0:1787388053.003720:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889408 00000100:00100000:1.0:1787388053.003735:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388053.003742:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971890048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.003781:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971890048:12345-0@lo:400:kworker.0 Request processed in 39us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.003787:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388053.003799:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787388053.003805:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971889280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.003837:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971889280:12345-0@lo:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.003843:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787388053.004105:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787388053.004113:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971889408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.004149:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971889408:12345-0@lo:400:kworker.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.004164:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787388053.004186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888896 00000100:00100000:1.0:1787388053.004190:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888896 00000100:00100000:1.0:1787388053.004211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971889920 00000100:00100000:1.0:1787388053.004215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971889920 00000100:00100000:1.0:1787388053.004234:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787388053.004240:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971888896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.004273:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971888896:12345-0@lo:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.004278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787388053.004290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787388053.004295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971889920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.004317:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971889920:12345-0@lo:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.004322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00080000:1.0:1787388053.004357:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfdf80 x1874211971889280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388053.004370:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971889280:0@lo:400:kworker.0 00010000:00080000:1.0:1787388053.004409:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfd500 x1874211971890048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388053.004418:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971890048:0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.004444:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971888896:0@lo:400:kworker.0 00010000:00080000:1.0:1787388053.004454:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfc700 x1874211971889408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388053.004476:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971889408:0@lo:400:kworker.0 00010000:00080000:1.0:1787388053.004489:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfc380 x1874211971889920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388053.004496:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971889920:0@lo:400:kworker.0 00000100:00080000:3.0:1787388053.004787:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388053.004793:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388053.004795:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388053.004798:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388053.004817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971888768 00000100:00100000:3.0:1787388053.004822:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971888768 00000100:00100000:3.0:1787388053.004870:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787388053.004877:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971888768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388053.004920:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971888768:12345-0@lo:400:kworker.0 Request processed in 44us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388053.004926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:3.0:1787388053.004974:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2344700 x1874211971888512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388053.005006:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971888512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388053.006159:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971888768:0@lo:400:kworker.0 00000100:00100000:1.0:1787388053.339476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388053.339527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388053.339594:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936064 00000100:00100000:0.0:1787388053.339604:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936064 00000100:00100000:0.0:1787388053.339670:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936192 00000100:00100000:0.0:1787388053.339674:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936192 00000100:00100000:0.0:1787388053.339724:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:0.0:1787388053.339734:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2400:x1874211952936064:12345-192.168.204.52@tcp:9:kworker.0 00000020:00000080:0.0:1787388053.339765:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811bb0 00000100:00080000:0.0:1787388053.339774:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9272c23f0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388053.339816:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787388053.339984:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+2:2400:x1874211952936064:12345-192.168.204.52@tcp:9:kworker.0 Request processed in 250us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.339993:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:0.0:1787388053.340007:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:0.0:1787388053.340013:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2400:x1874211952936192:12345-192.168.204.52@tcp:9:kworker.0 00000020:00000080:0.0:1787388053.340025:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811bb7 00000100:00080000:0.0:1787388053.340029:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9272c23f7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388053.340053:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787388053.340118:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+2:2400:x1874211952936192:12345-192.168.204.52@tcp:9:kworker.0 Request processed in 104us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.340125:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 25 00010000:00010000:0.0:1787388053.340146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388053.340245:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388053.341469:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388053.341477:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388053.353181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388053.353233:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388053.353263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388053.353283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388053.353308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388053.353346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935680 00000100:00100000:0.0:1787388053.353355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935680 00000100:00100000:0.0:1787388053.353421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935936 00000100:00100000:0.0:1787388053.353425:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935936 00000100:00100000:0.0:1787388053.353440:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935552 00000100:00100000:0.0:1787388053.353442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935552 00000100:00100000:0.0:1787388053.353454:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935808 00000100:00100000:0.0:1787388053.353456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935808 00000100:00100000:0.0:1787388053.353472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 173 00000100:00100000:0.0:1787388053.353482:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952935680:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388053.353554:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952935680:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.353563:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 173 00000100:00100000:0.0:1787388053.353582:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 174 00000100:00100000:0.0:1787388053.353588:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952935936:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388053.353612:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952935936:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.353618:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 174 00000100:00100000:0.0:1787388053.353630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 175 00000100:00100000:0.0:1787388053.353636:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952935552:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388053.353659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952935552:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.353664:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 175 00000100:00100000:0.0:1787388053.353709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 176 00000100:00100000:0.0:1787388053.353716:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952935808:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388053.353741:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952935808:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.353746:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 176 00000100:00080000:0.0:1787388053.353773:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388053.353776:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388053.354425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952935424 00000100:00100000:3.0:1787388053.354434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952935424 00000100:00100000:3.0:1787388053.354480:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 310 00000100:00100000:3.0:1787388053.354489:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952935424:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388053.354541:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952935424:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 53us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388053.354548:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 310 00010000:00010000:0.0:1787388053.642634:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388053.666896:0:12898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388053.667195:0:12898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787388054.666163:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388055.688987:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388056.072353:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388056.072377:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971890304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388056.072450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388056.072492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971890176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388056.072518:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890304 00000100:00100000:2.0:1787388056.072525:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890304 00000100:00100000:0.0:1787388056.072532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388056.072594:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890176 00000100:00100000:1.0:1787388056.072598:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890176 00000100:00100000:1.0:1787388056.072626:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787388056.072633:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971890304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388056.072659:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388056.072731:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971890304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388056.072739:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787388056.073223:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787388056.073236:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971890176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388056.073249:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787388056.076996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecfd500 x1874211971890176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388056.077023:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971890176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388056.077044:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971890176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3809us (4509us total) trans 0 rc 0/0 00000100:00080000:0.0:1787388056.077063:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388056.077075:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1787388056.077113:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eedd0000 x1874211971890304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388056.077616:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971890304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388056.586579:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388056.586603:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971890432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388056.586714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388056.587197:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890432 00000100:00100000:1.0:1787388056.587207:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890432 00000100:00100000:1.0:1787388056.587258:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787388056.587269:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971890432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388056.587299:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388056.587357:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971890432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388056.587377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787388056.587476:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971890432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388056.712937:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388057.372229:0:13043:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787388057.737464:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388058.120106:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971890560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388058.120215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388058.120422:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890560 00000100:00100000:1.0:1787388058.120431:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890560 00000100:00100000:1.0:1787388058.120498:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787388058.120509:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971890560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388058.120538:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388058.120581:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971890560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.120589:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787388058.120652:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388058.120664:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971890688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388058.120719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787388058.120766:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecff100 x1874211971890560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388058.120800:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971890560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388058.120870:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890688 00000100:00100000:1.0:1787388058.120874:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890688 00000100:00100000:3.0:1787388058.121143:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971890816:0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388058.121205:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971891328:0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121231:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388058.121250:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971891840:0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388058.121307:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787388058.121313:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971890944:0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121335:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388058.121351:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971891456:0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388058.121388:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971891968:0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388058.121431:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890816 00000100:00100000:3.0:1787388058.121435:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890816 00000100:00100000:3.0:1787388058.121464:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787388058.121471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971890816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.121509:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971890816:12345-0@lo:400:kworker.0 Request processed in 38us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388058.121515:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787388058.121556:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.121623:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787388058.121632:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971890688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388058.121656:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388058.121724:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971890688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.121730:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787388058.123485:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891328 00000100:00100000:0.0:1787388058.123498:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891328 00000100:00100000:1.0:1787388058.123745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891840 00000100:00100000:1.0:1787388058.123750:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891840 00000100:00080000:2.0:1787388058.123906:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388058.123913:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388058.124060:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891456 00000100:00100000:0.0:1787388058.124064:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891456 00000100:00100000:1.0:1787388058.124122:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971890944 00000100:00100000:1.0:1787388058.124126:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971890944 00000100:00100000:1.0:1787388058.124137:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891968 00000100:00100000:1.0:1787388058.124140:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891968 00000100:00100000:1.0:1787388058.124158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787388058.124167:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971891840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124250:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971891840:12345-0@lo:400:kworker.0 Request processed in 84us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.124276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787388058.124293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787388058.124309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971890944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124341:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971890944:12345-0@lo:400:kworker.0 Request processed in 33us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.124347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787388058.124358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787388058.124364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971891968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124395:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971891968:12345-0@lo:400:kworker.0 Request processed in 30us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.124400:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787388058.124427:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971891200:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388058.124493:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971891712:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388058.124530:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971892224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388058.124553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388058.124610:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971890688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388058.124638:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388058.124644:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971891072:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388058.124714:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971891584:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388058.124769:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971892096:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.124791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787388058.124844:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388058.124854:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388058.124891:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971890944:0@lo:400:kworker.0 00010000:00080000:2.0:1787388058.124908:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbc000 x1874211971891968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388058.124919:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971891968:0@lo:400:kworker.0 00000100:00100000:2.0:1787388058.124931:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971891840:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.125332:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891200 00000100:00100000:1.0:1787388058.125339:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891200 00000100:00100000:1.0:1787388058.125376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787388058.125383:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971891200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.125426:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971891200:12345-0@lo:400:kworker.0 Request processed in 43us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.125432:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787388058.125450:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971892224 00000100:00100000:1.0:1787388058.125454:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971892224 00000100:00100000:1.0:1787388058.125487:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787388058.125493:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971892224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388058.125510:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388058.125541:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971892224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.125546:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787388058.125557:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388058.125575:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891712 00000100:00100000:1.0:1787388058.125578:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891712 00000100:00100000:1.0:1787388058.125614:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891072 00000100:00100000:1.0:1787388058.125617:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891072 00000100:00100000:1.0:1787388058.125628:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971891584 00000100:00100000:1.0:1787388058.125630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971891584 00000100:00100000:1.0:1787388058.125645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787388058.125651:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971891712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.125695:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971891712:12345-0@lo:400:kworker.0 Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.125712:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787388058.125724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787388058.125728:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971891072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.125766:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971891072:12345-0@lo:400:kworker.0 Request processed in 37us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.125772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787388058.125783:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787388058.125789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971891584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.125987:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971892096 00000100:00100000:3.0:1787388058.125997:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971892096 00000100:00100000:3.0:1787388058.126018:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787388058.126026:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971891328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.126065:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971891328:12345-0@lo:400:kworker.0 Request processed in 41us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388058.126072:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787388058.126084:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787388058.126090:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971891456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.126118:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971891456:12345-0@lo:400:kworker.0 Request processed in 28us (4744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388058.126123:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787388058.126133:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787388058.126139:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971892096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388058.126164:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971892096:12345-0@lo:400:kworker.0 Request processed in 25us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388058.126169:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1787388058.126199:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3caa680 x1874211971891456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388058.126211:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971891456:0@lo:400:kworker.0 00010000:00080000:3.0:1787388058.126223:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2344700 x1874211971891328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388058.126231:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971891328:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.126280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971891584:12345-0@lo:400:kworker.0 Request processed in 25us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.126287:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:1.0:1787388058.126319:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388058.126323:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388058.126341:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971891072:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.126352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971891584:0@lo:400:kworker.0 00010000:00080000:1.0:1787388058.126361:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbed80 x1874211971892096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388058.126369:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971892096:0@lo:400:kworker.0 00000100:00100000:1.0:1787388058.126378:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971891200:0@lo:400:kworker.0 00010000:00080000:1.0:1787388058.126388:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbdf80 x1874211971891712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388058.126396:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971891712:0@lo:400:kworker.0 00010000:00080000:1.0:1787388058.126404:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c364d180 x1874211971892224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388058.126423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971892224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388058.472251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388058.472538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936320 00000100:00100000:3.0:1787388058.472549:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936320 00000100:00100000:0.0:1787388058.473144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 312 00000100:00100000:0.0:1787388058.473159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952936320:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388058.473236:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952936320:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 82us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388058.473245:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 312 00000100:00100000:1.0:1787388058.477762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388058.477810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388058.477829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388058.477871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388058.477904:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936448 00000100:00100000:1.0:1787388058.477914:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936448 00000100:00100000:0.0:1787388058.477924:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936576 00000100:00100000:0.0:1787388058.477931:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936576 00000100:00100000:1.0:1787388058.477973:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936704 00000100:00100000:1.0:1787388058.477977:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936704 00000100:00100000:1.0:1787388058.477992:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936832 00000100:00100000:1.0:1787388058.477994:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936832 00000100:00100000:1.0:1787388058.478009:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 183 00000100:00100000:1.0:1787388058.478018:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952936448:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388058.478105:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952936448:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.478113:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 183 00000100:00100000:1.0:1787388058.478130:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 184 00000100:00100000:1.0:1787388058.478137:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952936576:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388058.478161:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952936576:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.478168:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 184 00000100:00100000:1.0:1787388058.478180:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 185 00000100:00100000:1.0:1787388058.478187:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952936704:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388058.478202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 186 00000100:00100000:1.0:1787388058.478213:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952936704:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388058.478216:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952936832:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388058.478239:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 185 00000100:00100000:0.0:1787388058.478256:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952936832:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388058.478264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 186 00000100:00080000:1.0:1787388058.478271:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388058.478276:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787388058.760031:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787388059.147145:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000020:00000080:0.0:1787388059.147154:0:9516:0:(genops.c:906:class_export_put()) final put ffff9272c23f3800/55e2df5a-9363-4cf8-8d34-c496b357ff54 00000020:00000080:1.0:1787388059.147242:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c23f3800/55e2df5a-9363-4cf8-8d34-c496b357ff54 for lustre-OST0001 00000020:00000080:1.0:1787388059.147389:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c23f7000 for lustre-OST0001 00000001:00100000:3.0:1787388059.148184:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000020:00000080:3.0:1787388059.148196:0:8429:0:(genops.c:906:class_export_put()) final put ffff9272c23f6000/55e2df5a-9363-4cf8-8d34-c496b357ff54 00000020:00000080:1.0:1787388059.148324:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c23f6000/55e2df5a-9363-4cf8-8d34-c496b357ff54 for lustre-OST0000 00000020:00000080:1.0:1787388059.148429:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c23f0000 for lustre-OST0000 00010000:00010000:1.0:1787388059.784293:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787388060.549345:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff36dabed0 00000020:00000080:1.0:1787388060.549364:0:13191:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787388060.549370:0:13191:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787388060.549378:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff36dae160 20000000:00000080:1.0:1787388060.549386:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9272c2410c00 uarg=0000000000000000 20000000:01000000:1.0:1787388060.549437:0:13191:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787388060.549443:0:13191:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787388060.549449:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787388060.551391:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787388060.551574:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787388060.571294:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787388060.572642:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572671:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572692:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572699:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572706:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572713:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572721:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572750:0:13191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572810:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572827:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 12 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.572842:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892352:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388060.572945:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.572954:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.572963:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892480:0@lo:104: 00000100:00100000:2.0:1787388060.573010:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388060.573055:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.573063:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.573073:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892608:0@lo:104: 00000100:00100000:2.0:1787388060.573098:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388060.573128:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.573129:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971892480 00000100:00100000:1.0:1787388060.573139:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971892480 00010000:00010000:2.0:1787388060.573152:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 23 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.573163:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892736:0@lo:104: 00000100:00100000:2.0:1787388060.573186:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388060.573192:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971892608 00000100:00100000:1.0:1787388060.573196:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971892608 00010000:00010000:2.0:1787388060.573206:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.573211:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971892736 00000100:00100000:1.0:1787388060.573216:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971892736 00010000:00010000:2.0:1787388060.573217:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.573227:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892864:0@lo:104: 00000100:00100000:1.0:1787388060.573234:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787388060.573260:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:13191:x1874211971892480:12345-0@lo:104: 00000100:00100000:2.0:1787388060.573262:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787388060.573278:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.573285:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.573297:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 12 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.573306:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892992:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388060.573343:0:13191:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fbf61180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388060.573368:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892480:0@lo:104: 00000100:00100000:3.0:1787388060.573371:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787388060.573381:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787388060.575301:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971892864 00000100:00100000:3.0:1787388060.575314:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971892864 00000100:00100000:2.0:1787388060.577354:0:13193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787388060.577373:0:13193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:13191:x1874211971892608:12345-0@lo:104: 00010000:00010000:2.0:1787388060.577394:0:13193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.583858:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787388060.583893:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+6:13191:x1874211971892480:12345-0@lo:104: Request processed in 10639us (10878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388060.583908:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787388060.583950:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388060.583963:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:13191:x1874211971892736:12345-0@lo:104: 00010000:00010000:1.0:1787388060.583983:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.584076:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787388060.584082:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:13191:x1874211971892736:12345-0@lo:104: Request processed in 125us (10896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388060.584088:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388060.584879:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388060.584892:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:13191:x1874211971892864:12345-0@lo:104: 00010000:00010000:1.0:1787388060.584904:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.584962:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787388060.584968:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:13191:x1874211971892864:12345-0@lo:104: Request processed in 80us (11708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388060.584975:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787388060.585003:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787388060.585009:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585017:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388060.585022:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585047:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388060.585054:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388060.585059:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787388060.585892:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585903:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388060.585931:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585938:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b4e00/0x5cb77467b1811b7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585956:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388060.585960:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585965:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388060.585968:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.585975:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388060.585982:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388060.585996:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787388060.586015:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.586020:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388060.586026:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.586031:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23fe400/0x5cb77467b1811b63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b6a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.586041:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388060.586045:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.586050:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388060.586053:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.586059:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388060.586064:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388060.586069:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787388060.586079:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.586085:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388060.586905:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388060.586913:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388060.586938:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971893120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388060.587002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388060.587056:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388060.587065:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971893248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388060.587090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787388060.587529:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.587542:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafa400/0x5cb77467b1811b55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.587560:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388060.587563:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388060.587565:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388060.588472:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388060.588492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971893376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388060.588547:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388060.593037:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892736:0@lo:104: 00000100:00100000:2.0:1787388060.593053:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892864:0@lo:104: 00000100:00100000:2.0:1787388060.593130:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892608:0@lo:104: 00010000:00010000:2.0:1787388060.593157:0:13193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388060.593165:0:13193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:13191:x1874211971892608:12345-0@lo:104: Request processed in 15799us (20066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388060.593177:0:13193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787388060.593304:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892352:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388060.593535:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211971892992:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388060.593578:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.593623:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388060.595672:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893120 00000100:00100000:1.0:1787388060.595700:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893120 00010000:00010000:1.0:1787388060.595753:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 24 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.595800:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893248 00000100:00100000:1.0:1787388060.595804:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893248 00010000:00010000:1.0:1787388060.595818:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 25 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.595829:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893376 00000100:00100000:1.0:1787388060.595832:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893376 00010000:00010000:1.0:1787388060.595842:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 26 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.595856:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388060.595865:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+26:3644:x1874211971893120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388060.595881:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388060.595886:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 26 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.595896:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 26 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.595927:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0031400/0x5cb77467b1811b86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811b7f expref: 26 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.595943:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388060.596014:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+25:3644:x1874211971893120:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (9012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388060.596853:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388060.596885:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388060.596897:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971893248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388060.596916:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388060.596924:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 24 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.596934:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 24 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.596948:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23ff400/0x5cb77467b1811b6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811b63 expref: 24 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.596960:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388060.596999:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3644:x1874211971893248:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (9907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388060.597006:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388060.597021:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388060.597028:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3647:x1874211971893376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388060.597123:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388060.597132:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388060.597140:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388060.597145:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388060.597154:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388060.597161:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388060.597168:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388060.597207:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388060.597214:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388060.597237:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388060.597256:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1811b71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811b78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388060.597288:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388060.597290:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388060.597293:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388060.597320:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971893504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388060.597360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388060.597443:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952936960 00000100:00100000:3.0:1787388060.597450:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952936960 00010000:00010000:3.0:1787388060.597478:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388060.597497:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893504 00000100:00100000:3.0:1787388060.597500:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893504 00010000:00010000:3.0:1787388060.597513:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.597877:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388060.597885:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.597904:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.597918:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0031e00/0x5cb77467b1811b5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811b55 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.597929:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388060.597963:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3647:x1874211971893376:12345-0@lo:103:ldlm_bl.0 Request processed in 936us (9415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388060.597970:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388060.597990:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:1.0:1787388060.597998:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952936960:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388060.598007:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388060.598012:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.598024:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.598034:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811b9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bee expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.598043:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388060.598089:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:2404:x1874211952936960:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 92us (4467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388060.598591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388060.598740:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937088 00000100:00100000:2.0:1787388060.598747:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937088 00010000:00010000:2.0:1787388060.598770:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388060.598803:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388060.598811:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3647:x1874211971893504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388060.598822:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388060.598827:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598837:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598859:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafbc00/0x5cb77467b1811b78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811b71 expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598871:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388060.598904:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3647:x1874211971893504:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388060.598910:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388060.598925:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:2.0:1787388060.598931:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952937088:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388060.598939:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388060.598943:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598952:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598962:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0030a00/0x5cb77467b1811b4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4baf expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598985:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.598993:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599008:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599015:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599028:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599034:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599039:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388060.599044:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599053:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599070:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.599074:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 43 00010000:00010000:2.0:1787388060.599088:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388060.599119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2404:x1874211952937088:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 188us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388060.599126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 45 00010000:00010000:2.0:1787388060.599180:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599189:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.599196:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1811bbe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388060.599205:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971893248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388060.599229:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971893120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388060.599415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971893504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388060.599424:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971893376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388060.813345:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388061.192120:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971893632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388061.192196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388061.192389:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893632 00000100:00100000:1.0:1787388061.192397:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893632 00000100:00100000:1.0:1787388061.192451:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787388061.192459:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971893632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388061.192485:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388061.192522:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971893632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388061.192534:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787388061.192605:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787388061.192707:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5880 x1874211971893632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388061.192726:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971893632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388061.192750:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388061.192757:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971893760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388061.192782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388061.192881:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893760 00000100:00100000:1.0:1787388061.192886:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893760 00000100:00100000:1.0:1787388061.193004:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787388061.193259:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388061.193291:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971893760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388061.193305:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388061.193351:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971893760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 228us (568us total) trans 0 rc 0/0 00010000:00080000:2.0:1787388061.193404:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbd880 x1874211971893760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388061.193418:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971893760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388061.199044:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787388061.704756:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971893888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388061.704838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388061.704947:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971893888 00000100:00100000:1.0:1787388061.704955:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971893888 00000100:00100000:1.0:1787388061.705009:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787388061.705019:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971893888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388061.705056:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388061.705103:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971893888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388061.705109:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787388061.705202:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971893888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388061.832074:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388062.168761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388062.168794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937216 00000100:00100000:3.0:1787388062.168804:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937216 00000100:00100000:3.0:1787388062.168969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 313 00000100:00100000:3.0:1787388062.168980:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:6174:x1874211952937216:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388062.168997:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388062.169017:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c1f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.169048:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.169059:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.169088:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031200, rc 0) 00000100:00100000:3.0:1787388062.169145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952937216:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 167us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.169152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 313 00000100:00100000:0.0:1787388062.176138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388062.176634:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937344 00000100:00100000:3.0:1787388062.176645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937344 00000100:00100000:3.0:1787388062.178782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 314 00000100:00100000:3.0:1787388062.178807:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952937344:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388062.178997:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952937344:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 200us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.179006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 314 00000100:00100000:1.0:1787388062.192035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388062.195088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937472 00000100:00100000:0.0:1787388062.195104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937472 00000100:00100000:0.0:1787388062.195168:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 315 00000100:00100000:0.0:1787388062.195179:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952937472:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.195406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952937472:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 227us (3379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388062.195423:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 315 00000100:00100000:2.0:1787388062.213163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388062.215073:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937600 00000100:00100000:3.0:1787388062.215088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937600 00000100:00100000:3.0:1787388062.215159:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 316 00000100:00100000:3.0:1787388062.215169:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952937600:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388062.215187:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388062.215205:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c26 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.215242:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.215253:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.215262:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030e00, rc 0) 00000100:00100000:3.0:1787388062.215337:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952937600:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 169us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.215346:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 316 00000100:00100000:2.0:1787388062.221286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388062.221573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937728 00000100:00100000:1.0:1787388062.221583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937728 00000100:00100000:1.0:1787388062.221644:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 317 00000100:00100000:1.0:1787388062.221654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952937728:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388062.221849:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952937728:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 195us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.222243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 317 00000100:00100000:1.0:1787388062.225436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388062.226113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937856 00000100:00100000:3.0:1787388062.226123:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937856 00000100:00100000:3.0:1787388062.226182:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 318 00000100:00100000:3.0:1787388062.226193:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952937856:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388062.226345:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952937856:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 153us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.226354:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 318 10000000:01000000:1.0:1787388062.547107:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787388062.547116:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401ba8000 from 7 10000000:01000000:1.0:1787388062.547122:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388062.547173:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.547186:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.547200:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388062.547239:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388062.547306:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.547340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894016 00000100:00100000:1.0:1787388062.547346:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894016 00000100:00100000:1.0:1787388062.547398:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787388062.547407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971894016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388062.547420:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388062.547433:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811bd3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.547462:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.547473:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.547482:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b5c00, rc 0) 00000100:00100000:1.0:1787388062.547514:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971894016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.547534:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787388062.547583:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ab5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787388062.547603:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388062.547616:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.547625:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388062.553925:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388062.554069:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.554115:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388062.564505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894144 00000100:00100000:3.0:1787388062.564598:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894144 00000100:00100000:3.0:1787388062.565105:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787388062.565117:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971894144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388062.568788:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971894144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3663us (14708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.568803:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787388062.572942:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.573017:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.573101:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388062.573146:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388062.573260:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894272 00000100:00100000:2.0:1787388062.573267:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894272 00000100:00100000:2.0:1787388062.573317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787388062.573326:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971894272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.573461:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971894272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388062.573469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787388062.573613:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388062.575370:0:13271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787388062.575629:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787388062.575670:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388062.575803:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.575816:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388062.575826:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388062.575829:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eef18800 from 7 10000000:01000000:0.0:1787388062.575832:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388062.575873:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.575881:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.575893:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388062.575919:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.575990:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388062.576077:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388062.579622:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894400 00000100:00100000:3.0:1787388062.579813:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894400 00000100:00100000:2.0:1787388062.580082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787388062.580095:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971894400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388062.580113:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388062.580134:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811be1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.580247:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.580279:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.580289:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00100000:2.0:1787388062.580374:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971894400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388062.580381:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787388062.580883:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388062.580906:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.580917:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388062.580997:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.581038:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388062.581075:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388062.581144:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894528 00000100:00100000:3.0:1787388062.581150:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894528 00000100:00100000:3.0:1787388062.581178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787388062.581186:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971894528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388062.581308:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971894528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.581316:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787388062.581396:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.581425:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.581459:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388062.581485:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388062.581924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894656 00000100:00100000:2.0:1787388062.581930:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894656 00000100:00100000:2.0:1787388062.581975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787388062.581983:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971894656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.582073:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971894656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388062.582079:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787388062.582103:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787388062.584367:0:13272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787388062.584579:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787388062.584606:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388062.584618:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.584632:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388062.584655:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388062.584665:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eedc0000 from 7 10000000:01000000:0.0:1787388062.584668:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388062.584737:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.584746:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.584759:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388062.584786:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.584854:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388062.584902:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c95f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388062.585430:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894784 00000100:00100000:3.0:1787388062.585440:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894784 00000100:00100000:3.0:1787388062.585616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787388062.585629:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971894784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388062.585654:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388062.585697:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811bef expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.585728:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.585740:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.585749:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030600, rc 0) 00000100:00100000:3.0:1787388062.585799:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971894784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.585805:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787388062.587671:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388062.589608:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388062.589625:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388062.590113:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388062.590187:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388062.590332:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971894912 00000100:00100000:2.0:1787388062.590340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971894912 00000100:00100000:2.0:1787388062.590389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787388062.590398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971894912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.590532:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971894912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388062.590541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787388062.590617:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787388062.590644:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971894912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388062.590864:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388062.591114:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.591173:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787388062.591274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895040 00000100:00100000:2.0:1787388062.591279:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895040 00000100:00100000:2.0:1787388062.591319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787388062.591328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971895040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.591418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971895040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388062.591432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787388062.591538:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787388062.600156:0:13273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787388062.600913:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787388062.600941:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787388062.600954:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.600967:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388062.600978:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388062.600980:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c9714000 from 7 10000000:01000000:2.0:1787388062.600983:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388062.601024:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.601033:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.601044:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388062.601070:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.601137:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388062.601193:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388062.601251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895168 00000100:00100000:0.0:1787388062.601260:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895168 00000100:00100000:0.0:1787388062.601319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787388062.601328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971895168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388062.601341:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388062.601353:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811bfd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.601375:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.601385:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.601393:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa800, rc 0) 00000100:00100000:0.0:1787388062.601439:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971895168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388062.601459:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787388062.601657:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388062.601671:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388062.601710:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388062.601768:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.601793:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388062.601814:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388062.601924:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895296 00000100:00100000:0.0:1787388062.601928:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895296 00000100:00100000:0.0:1787388062.601959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787388062.601966:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971895296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.602075:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971895296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388062.602082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787388062.602181:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.602218:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388062.602258:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388062.602279:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388062.602317:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895424 00000100:00100000:0.0:1787388062.602321:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895424 00000100:00100000:0.0:1787388062.602348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787388062.602353:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971895424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388062.602423:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971895424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388062.602430:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787388062.602496:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971895424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388062.604551:0:13274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787388062.605042:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787388062.605067:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388062.605078:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388062.605090:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388062.856226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388063.239884:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971895552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388063.239958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.240033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895552 00000100:00100000:1.0:1787388063.240040:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895552 00000100:00100000:1.0:1787388063.240095:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787388063.240106:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971895552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388063.240134:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388063.240180:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971895552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.240187:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787388063.240219:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388063.240249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c6680 x1874211971895552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388063.240268:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971895552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388063.241352:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971895680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388063.241406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.241744:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895680 00000100:00100000:1.0:1787388063.241751:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895680 00000100:00100000:1.0:1787388063.241788:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787388063.241796:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971895680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388063.241823:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388063.241864:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971895680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.241871:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787388063.241895:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971895936:0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.241920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.241939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971896448:0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.241960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.241974:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971896960:0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.241993:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.242020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787388063.242026:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971896064:0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.242060:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971896576:0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.242096:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971897088:0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388063.242139:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895936 00000100:00100000:1.0:1787388063.242143:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895936 00000100:00100000:1.0:1787388063.242163:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896960 00000100:00100000:1.0:1787388063.242165:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896960 00000100:00100000:1.0:1787388063.242184:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896064 00000100:00100000:1.0:1787388063.242206:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896064 00000100:00100000:1.0:1787388063.242223:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896576 00000100:00100000:1.0:1787388063.242225:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896576 00000100:00100000:1.0:1787388063.242239:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787388063.242244:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971895936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242281:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971895936:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.242288:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787388063.242300:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787388063.242306:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971896960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242332:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971896960:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.242338:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787388063.242349:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787388063.242355:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971896064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242380:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971896064:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.242385:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787388063.242396:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787388063.242400:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971896576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388063.242424:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971896576:12345-0@lo:400:kworker.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.242430:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787388063.242454:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896448 00000100:00100000:1.0:1787388063.242457:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896448 00000100:00100000:1.0:1787388063.242481:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897088 00000100:00100000:1.0:1787388063.242484:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897088 00000100:00100000:1.0:1787388063.242515:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787388063.242520:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971896448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242713:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787388063.242723:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971897088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242757:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971897088:12345-0@lo:400:kworker.0 Request processed in 37us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.242762:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787388063.242787:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971895808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388063.242841:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971896320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242862:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388063.242878:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971896832:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388063.242920:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787388063.242927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971896192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388063.242969:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971896704:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.242988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388063.243014:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971895808 00000100:00100000:3.0:1787388063.243018:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971895808 00000100:00100000:3.0:1787388063.243049:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787388063.243055:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3645:x1874211971895808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243088:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3645:x1874211971895808:12345-0@lo:400:kworker.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.243093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787388063.243119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896192 00000100:00100000:3.0:1787388063.243123:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896192 00000100:00100000:3.0:1787388063.243145:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787388063.243159:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971896192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243190:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971896192:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.243207:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787388063.243228:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896832 00000100:00100000:3.0:1787388063.243231:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896832 00000100:00100000:3.0:1787388063.243254:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896704 00000100:00100000:3.0:1787388063.243257:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896704 00000100:00100000:3.0:1787388063.243276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787388063.243282:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971896832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243311:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971896832:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.243317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787388063.243328:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787388063.243333:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971896704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243359:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971896704:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.243364:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787388063.243380:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971896320 00000100:00100000:3.0:1787388063.243383:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971896320 00000100:00100000:3.0:1787388063.243400:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787388063.243405:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971896320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243433:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971896320:12345-0@lo:400:kworker.0 Request processed in 28us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.243438:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787388063.243479:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971895680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388063.243521:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971896192:0@lo:400:kworker.0 00010000:00080000:3.0:1787388063.243534:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85f80 x1874211971896704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388063.243544:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971896704:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243552:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971895808:0@lo:400:kworker.0 00010000:00080000:3.0:1787388063.243567:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4000 x1874211971896320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388063.243576:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971896320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.243585:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971896832:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.244182:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388063.244203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971897216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388063.244239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388063.244270:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897216 00000100:00100000:3.0:1787388063.244275:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897216 00000100:00100000:3.0:1787388063.244304:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787388063.244311:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971897216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388063.244327:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388063.244362:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971897216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388063.244368:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1787388063.244400:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4000 x1874211971897216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388063.244412:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971897216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388063.244628:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971896448:12345-0@lo:400:kworker.0 Request processed in 2107us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.244635:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787388063.244663:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388063.244667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388063.244670:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388063.244672:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388063.244768:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971896064:0@lo:400:kworker.0 00000100:00100000:0.0:1787388063.244779:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971896576:0@lo:400:kworker.0 00010000:00080000:0.0:1787388063.244790:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85500 x1874211971897088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388063.244799:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971897088:0@lo:400:kworker.0 00000100:00100000:0.0:1787388063.244810:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971895936:0@lo:400:kworker.0 00010000:00080000:0.0:1787388063.244821:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c5880 x1874211971896448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388063.244838:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971896448:0@lo:400:kworker.0 00010000:00080000:0.0:1787388063.244852:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa86300 x1874211971896960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388063.244859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971896960:0@lo:400:kworker.0 00000100:00100000:3.0:1787388063.574894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388063.574973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388063.577967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388063.577997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388063.578765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952937984 00000100:00100000:1.0:1787388063.578778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952937984 00000100:00100000:1.0:1787388063.578840:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 332 00000100:00100000:1.0:1787388063.578850:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952937984:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388063.578919:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952937984:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 70us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.578926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 332 00000100:00100000:0.0:1787388063.579105:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938112 00000100:00100000:0.0:1787388063.579111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938112 00000100:00100000:0.0:1787388063.579159:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938368 00000100:00100000:0.0:1787388063.579162:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938368 00000100:00100000:0.0:1787388063.579184:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 193 00000100:00100000:0.0:1787388063.579202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952938112:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388063.579244:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952938112:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 44us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388063.579250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 193 00000100:00100000:0.0:1787388063.579264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 194 00000100:00100000:0.0:1787388063.579270:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952938368:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388063.579292:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952938368:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 22us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388063.579298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 194 00000100:00080000:1.0:1787388063.580705:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388063.586127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388063.589171:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938240 00000100:00100000:1.0:1787388063.589198:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938240 00000100:00100000:1.0:1787388063.589263:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938496 00000100:00100000:1.0:1787388063.589267:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938496 00000100:00100000:1.0:1787388063.589298:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 195 00000100:00100000:1.0:1787388063.589308:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952938240:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388063.589397:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952938240:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 90us (11398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.589405:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 195 00000100:00100000:1.0:1787388063.589423:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 196 00000100:00100000:1.0:1787388063.589430:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952938496:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388063.589466:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952938496:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 37us (3349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388063.589473:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 196 00000100:00080000:1.0:1787388063.589500:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787388063.879979:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787388064.387751:0:13391:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787388064.904825:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388065.928201:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388066.311944:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971897344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388066.312018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388066.312195:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897344 00000100:00100000:0.0:1787388066.312203:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897344 00000100:00100000:0.0:1787388066.312262:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787388066.312279:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971897344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388066.312311:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388066.312357:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971897344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388066.312364:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787388066.312415:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787388066.312447:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c361ad80 x1874211971897344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388066.312464:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971897344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388066.313064:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971897472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388066.313102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388066.313193:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897472 00000100:00100000:0.0:1787388066.313198:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897472 00000100:00100000:0.0:1787388066.313242:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787388066.313249:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971897472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388066.313262:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388066.313296:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971897472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388066.313303:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1787388066.313371:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c361b100 x1874211971897472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388066.313386:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971897472:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787388066.313402:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388066.826882:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971897600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388066.826956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388066.827070:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897600 00000100:00100000:1.0:1787388066.827080:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897600 00000100:00100000:1.0:1787388066.827143:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787388066.827153:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971897600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388066.827187:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388066.831648:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971897600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4475us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388066.831665:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787388066.836553:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971897600:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388066.953053:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388067.977379:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388068.360050:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971897728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388068.360140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.360208:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897728 00000100:00100000:3.0:1787388068.360215:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897728 00000100:00100000:3.0:1787388068.360268:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787388068.360278:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971897728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388068.360306:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388068.360349:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971897728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.360356:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787388068.360376:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787388068.360405:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa86680 x1874211971897728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388068.360421:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971897728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388068.361524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971897984:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.361629:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971898496:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.361672:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971899008:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.361743:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787388068.361748:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971898112:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.361781:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971898624:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.361821:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971899136:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.361874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897984 00000100:00100000:3.0:1787388068.361880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897984 00000100:00100000:3.0:1787388068.361922:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787388068.361929:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971897984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.361972:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971897984:12345-0@lo:400:kworker.0 Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.361979:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787388068.362010:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898496 00000100:00100000:3.0:1787388068.362013:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898496 00000100:00100000:3.0:1787388068.362035:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787388068.362040:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971898496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362071:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971898496:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.362109:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787388068.362129:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899008 00000100:00100000:3.0:1787388068.362133:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899008 00000100:00100000:3.0:1787388068.362166:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898112 00000100:00100000:3.0:1787388068.362169:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898112 00000100:00100000:3.0:1787388068.362182:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899136 00000100:00100000:3.0:1787388068.362184:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899136 00000100:00100000:3.0:1787388068.362200:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787388068.362206:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971899008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362235:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971899008:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.362242:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787388068.362252:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787388068.362257:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971898112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362281:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971898112:12345-0@lo:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.362286:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787388068.362295:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787388068.362300:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971899136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362321:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971899136:12345-0@lo:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.362326:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787388068.362345:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898624 00000100:00100000:3.0:1787388068.362349:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898624 00000100:00100000:3.0:1787388068.362375:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787388068.362381:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971898624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362420:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971898624:12345-0@lo:400:kworker.0 Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.362426:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787388068.362460:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971897856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388068.362489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.362509:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.362543:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971898880:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.362571:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971899392:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.362605:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388068.362611:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971898240:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.362646:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971898752:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.362665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388068.364750:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388068.364772:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971899520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388068.364835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388068.364888:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898240 00000100:00100000:0.0:1787388068.364894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898240 00000100:00100000:0.0:1787388068.364981:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899520 00000100:00100000:0.0:1787388068.364985:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899520 00000100:00100000:0.0:1787388068.365000:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787388068.365007:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1874211971898240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388068.365092:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1874211971898240:12345-0@lo:400:kworker.0 Request processed in 73us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.365127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787388068.365144:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787388068.365150:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971899520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388068.365171:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388068.365205:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971899520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.365212:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787388068.365253:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971899520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388068.366850:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971899264:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.366925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.366994:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971898240:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.367037:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971897856 00000100:00100000:3.0:1787388068.367044:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971897856 00000100:00100000:3.0:1787388068.367174:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787388068.367184:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971897856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388068.367208:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388068.367267:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971897856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.367274:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787388068.367297:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899392 00000100:00100000:3.0:1787388068.367305:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899392 00000100:00100000:3.0:1787388068.367329:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898752 00000100:00100000:3.0:1787388068.367332:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898752 00000100:00100000:3.0:1787388068.367353:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787388068.367359:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.367391:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971899392:12345-0@lo:400:kworker.0 Request processed in 32us (4802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.367397:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787388068.367408:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787388068.367415:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.367443:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971898752:12345-0@lo:400:kworker.0 Request processed in 29us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.367448:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787388068.367475:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898368 00000100:00100000:3.0:1787388068.367479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898368 00000100:00100000:3.0:1787388068.367502:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971898880 00000100:00100000:3.0:1787388068.367505:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971898880 00000100:00100000:3.0:1787388068.367517:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899264 00000100:00100000:3.0:1787388068.367520:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899264 00000100:00100000:3.0:1787388068.367536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787388068.367541:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971898368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388068.367690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787388068.367700:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971898880:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787388068.371397:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388068.371409:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388068.371412:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388068.371414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388068.371441:0:9533:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787388068.371458:0:9533:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787388068.371709:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971898880:12345-0@lo:400:kworker.0 Request processed in 4006us (9141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.371721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787388068.371751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787388068.371762:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971899264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388068.371812:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971899264:12345-0@lo:400:kworker.0 Request processed in 53us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.371817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:2.0:1787388068.376353:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c6680 x1874211971898752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388068.376372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971898752:0@lo:400:kworker.0 00010000:00080000:2.0:1787388068.376388:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f3b80 x1874211971899264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388068.376397:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971899264:0@lo:400:kworker.0 00010000:00080000:2.0:1787388068.376433:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c209d880 x1874211971897856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388068.376450:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971897856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388068.376466:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971898880:0@lo:400:kworker.0 00010000:00080000:2.0:1787388068.376477:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36f2680 x1874211971899392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388068.376483:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971899392:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.377253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971898368:12345-0@lo:400:kworker.0 Request processed in 9705us (14716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.377266:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787388068.377405:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971898112:0@lo:400:kworker.0 00010000:00080000:1.0:1787388068.377422:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4000 x1874211971898624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388068.377431:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971898624:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.377444:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971899136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.377457:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971897984:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.377469:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971898496:0@lo:400:kworker.0 00010000:00080000:1.0:1787388068.377491:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2344700 x1874211971899008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388068.377498:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971899008:0@lo:400:kworker.0 00000100:00100000:2.0:1787388068.378332:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971898368:0@lo:400:kworker.0 00000100:00100000:0.0:1787388068.695903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388068.695955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388068.695985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388068.696019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388068.696049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388068.696115:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938880 00000100:00100000:0.0:1787388068.696124:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938880 00000100:00100000:0.0:1787388068.696173:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952939136 00000100:00100000:0.0:1787388068.696177:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952939136 00000100:00100000:0.0:1787388068.696190:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938752 00000100:00100000:0.0:1787388068.696192:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938752 00000100:00100000:0.0:1787388068.696204:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952939008 00000100:00100000:0.0:1787388068.696206:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952939008 00000100:00100000:0.0:1787388068.696224:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 203 00000100:00100000:0.0:1787388068.696232:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2402:x1874211952938880:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.696302:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2402:x1874211952938880:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 70us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.696310:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 203 00000100:00100000:0.0:1787388068.696339:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 204 00000100:00100000:0.0:1787388068.696345:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952939136:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.696368:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952939136:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.696374:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 204 00000100:00100000:0.0:1787388068.696384:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 205 00000100:00100000:0.0:1787388068.696389:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952938752:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.696409:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952938752:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 20us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.696414:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 205 00000100:00100000:0.0:1787388068.696424:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 206 00000100:00100000:0.0:1787388068.696429:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952939008:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.696448:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952939008:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 19us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.696460:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 206 00000100:00100000:1.0:1787388068.696831:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952938624 00000100:00100000:1.0:1787388068.696836:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952938624 00000100:00100000:1.0:1787388068.696875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 334 00000100:00100000:1.0:1787388068.696883:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2402:x1874211952938624:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388068.696912:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2402:x1874211952938624:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 31us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.696918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 334 00000100:00080000:1.0:1787388068.696954:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388068.696958:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787388069.000204:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787388070.004885:0:13541:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:41:08 (1787388068) === 00010000:00010000:0.0:1787388070.025826:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388070.298409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388070.298457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388070.298480:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952939392 00000100:00100000:0.0:1787388070.298491:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952939392 00000100:00080000:1.0:1787388070.298648:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388070.298726:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:0.0:1787388070.298740:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:74df45bd-a066-4da5-9401-b0a043132784+6:10531:x1874211952939392:12345-192.168.204.52@tcp:700:mkdir.0 00000100:00100000:2.0:1787388070.298800:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952939264 00000100:00100000:2.0:1787388070.298806:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952939264 00000100:00100000:0.0:1787388070.298829:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:74df45bd-a066-4da5-9401-b0a043132784+7:10531:x1874211952939392:12345-192.168.204.52@tcp:700:mkdir.0 Request processed in 92us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388070.298838:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:2.0:1787388070.298863:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:2.0:1787388070.298873:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952939264:12345-192.168.204.52@tcp:41:mkdir.0 00000004:00000024:2.0:1787388070.298899:0:13489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388070.299111:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952939264:12345-192.168.204.52@tcp:41:mkdir.0 Request processed in 239us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.299119:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:1.0:1787388070.309557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.309788:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952939648 00000100:00100000:2.0:1787388070.309798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952939648 00000100:00100000:2.0:1787388070.309894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:2.0:1787388070.309905:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:10531:x1874211952939648:12345-192.168.204.52@tcp:36:mkdir.0 00010000:00010000:2.0:1787388070.309961:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388070.310029:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1811aad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b9a expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310080:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273fbd42d00) 00010000:00010000:2.0:1787388070.310092:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388070.310188:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310201:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310211:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310223:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310231:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310238:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310808:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310818:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388070.310838:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4ec162e reply state 00000000e134caa5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310859:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310866:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273cb9ab200) 00010000:00010000:2.0:1787388070.310869:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388070.310872:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388070.310877:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787388070.310884:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310891:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310898:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310904:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388070.310908:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310915:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310923:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:2.0:1787388070.310925:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388070.310928:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310933:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c0b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388070.310956:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4ec162e reply state 00000000e134caa5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310966:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.310972:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9273cb9abc00) 00010000:00010000:2.0:1787388070.310974:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388070.310976:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787388070.311070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+7:10531:x1874211952939648:12345-192.168.204.52@tcp:36:mkdir.0 Request processed in 1164us (1520us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787388070.311079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787388070.333529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.333565:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952939776 00000100:00100000:3.0:1787388070.333578:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952939776 00000100:00100000:3.0:1787388070.333647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:3.0:1787388070.333658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+7:10532:x1874211952939776:12345-192.168.204.52@tcp:101:chmod.0 00010000:00010000:3.0:1787388070.333721:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388070.333745:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c2d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.333874:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.333893:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.333903:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388070.333948:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388070.333952:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388070.334048:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.334093:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c2d expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.334111:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c2d expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.334120:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273fbd42d00) 00010000:00010000:3.0:1787388070.334123:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388070.334139:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031600, rc 0) 00000100:00100000:3.0:1787388070.334203:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+8:10532:x1874211952939776:12345-192.168.204.52@tcp:101:chmod.0 Request processed in 547us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388070.334210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:1.0:1787388070.338398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.338506:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952940032 00000100:00100000:2.0:1787388070.338517:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952940032 00000100:00100000:2.0:1787388070.339312:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:2.0:1787388070.339322:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+8:10532:x1874211952940032:12345-192.168.204.52@tcp:36:chmod.0 00010000:00010000:2.0:1787388070.339379:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388070.339404:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c2d expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.339425:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273fbd42d00) 00010000:00010000:2.0:1787388070.339435:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388070.339459:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.339472:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.339482:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388070.339698:0:9533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056d2f074 reply state 000000005e4156f3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.339711:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.339718:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:2.0:1787388070.339720:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388070.339722:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388070.339730:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787388070.339827:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+9:10532:x1874211952940032:12345-192.168.204.52@tcp:36:chmod.0 Request processed in 505us (1440us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787388070.339834:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:1.0:1787388070.375776:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.378208:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952940160 00000100:00100000:2.0:1787388070.378223:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952940160 00000100:00100000:2.0:1787388070.378285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:2.0:1787388070.378293:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+9:10533:x1874211952940160:12345-192.168.204.52@tcp:101:chown.0 00010000:00010000:2.0:1787388070.378317:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388070.378337:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c34 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.378397:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811c3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.378410:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.378420:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388070.378477:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388070.378481:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388070.378516:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.378799:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c34 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.378819:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811c3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c34 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.378829:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:2.0:1787388070.378832:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388070.378835:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff800, rc 0) 00000100:00100000:2.0:1787388070.378906:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+10:10533:x1874211952940160:12345-192.168.204.52@tcp:101:chown.0 Request processed in 613us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.378914:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:1.0:1787388070.392838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.394461:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952940288 00000100:00100000:3.0:1787388070.394478:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952940288 00000100:00100000:3.0:1787388070.394918:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:3.0:1787388070.394931:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+10:10533:x1874211952940288:12345-192.168.204.52@tcp:101:chown.0 00010000:00010000:3.0:1787388070.394952:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388070.394975:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c3b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395048:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395074:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395085:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395098:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395105:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395110:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395184:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395218:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395225:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388070.395268:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388070.395271:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388070.395291:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395303:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395309:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395315:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395320:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.395324:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395331:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395343:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:3.0:1787388070.395346:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.395349:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395365:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395379:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395385:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395390:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395395:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0030a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.395398:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395404:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395411:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9273cb9abc00) 00010000:00010000:3.0:1787388070.395414:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.395416:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395421:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395450:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c3b expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395462:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c3b expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.395475:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273cb9ab200) 00010000:00010000:3.0:1787388070.395477:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388070.395480:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031600, rc 0) 00000100:00100000:3.0:1787388070.395900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+11:10533:x1874211952940288:12345-192.168.204.52@tcp:101:chown.0 Request processed in 970us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388070.395908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:1.0:1787388070.410927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388070.411030:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952940416 00000100:00100000:0.0:1787388070.411040:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952940416 00000100:00100000:0.0:1787388070.411110:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:0.0:1787388070.411121:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74df45bd-a066-4da5-9401-b0a043132784+11:10533:x1874211952940416:12345-192.168.204.52@tcp:900:chown.0 00000100:00100000:0.0:1787388070.411205:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74df45bd-a066-4da5-9401-b0a043132784+11:10533:x1874211952940416:12345-192.168.204.52@tcp:900:chown.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388070.411213:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:1.0:1787388070.418439:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.418546:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952940672 00000100:00100000:2.0:1787388070.418564:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952940672 00000100:00100000:2.0:1787388070.418627:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 28 00000100:00100000:2.0:1787388070.418638:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+11:10533:x1874211952940672:12345-192.168.204.52@tcp:36:chown.0 00010000:00010000:2.0:1787388070.418729:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388070.418756:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c3b expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.418779:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273cb9ab200) 00010000:00010000:2.0:1787388070.418798:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388070.418826:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.418840:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.418851:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388070.420924:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1787388070.421184:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421197:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421204:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421209:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.421214:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421221:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421236:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9273cb9abc00) 00010000:00010000:3.0:1787388070.421239:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.421243:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421249:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811c12 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421283:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421289:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421294:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421299:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fec00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.421302:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421308:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421316:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273cb9ab200) 00010000:00010000:3.0:1787388070.421318:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.421321:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421326:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811c19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421340:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421346:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421352:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421364:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.421367:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421374:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421382:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:3.0:1787388070.421385:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787388070.421388:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.421393:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811c2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388070.421508:0:9533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028ad2007 reply state 0000000084b8fd3f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.421532:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.421539:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273cb9ab200) 00010000:00010000:2.0:1787388070.421542:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388070.421544:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388070.421773:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787388070.421897:0:9533:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787388070.421915:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+7:10533:x1874211952940672:12345-192.168.204.52@tcp:36:chown.0 Request processed in 3276us (3482us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787388070.421923:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 28 00010000:00010000:3.0:1787388070.422597:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.422608:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.422615:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.422621:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.422625:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.422631:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.422657:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273cb9ab200) 00010000:00010000:3.0:1787388070.422660:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787388070.422664:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.422671:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c5f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388070.442022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.442165:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952940800 00000100:00100000:2.0:1787388070.442176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952940800 00000100:00100000:2.0:1787388070.442286:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:2.0:1787388070.442297:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+6:10534:x1874211952940800:12345-192.168.204.52@tcp:101:touch.500 00010000:00010000:2.0:1787388070.442321:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388070.442342:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c42 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388070.446260:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3846us 00010000:00010000:3.0:1787388070.457759:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457782:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457793:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457810:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457818:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457824:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457950:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457959:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.457974:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388070.458009:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388070.458013:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388070.458074:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458087:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458092:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458099:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458104:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.458109:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458116:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458129:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:3.0:1787388070.458132:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.458136:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458143:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031e00/0x5cb77467b1811c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458164:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458169:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458175:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458180:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0030a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.458183:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458188:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458197:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9273fbd42300) 00010000:00010000:3.0:1787388070.458200:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.458202:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458207:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030a00/0x5cb77467b1811c74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458246:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c42 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458263:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c42 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.458280:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:3.0:1787388070.458283:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787388070.458286:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031400, rc 0) 00000100:00100000:3.0:1787388070.458367:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+7:10534:x1874211952940800:12345-192.168.204.52@tcp:101:touch.500 Request processed in 16071us (16484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388070.458376:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:1.0:1787388070.462617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.462810:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952941056 00000100:00100000:3.0:1787388070.462820:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952941056 00000100:00100000:3.0:1787388070.462881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:3.0:1787388070.462891:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+7:10534:x1874211952941056:12345-192.168.204.52@tcp:101:touch.500 00010000:00010000:3.0:1787388070.462915:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388070.462937:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c82 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c49 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463098:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463114:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463125:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463188:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463196:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463214:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388070.463615:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787388070.463769:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1811c97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463779:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1811c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463787:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1811c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463815:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463822:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463829:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463835:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.463840:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463848:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463860:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:3.0:1787388070.463863:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.463873:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463879:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811c89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388070.463892:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050fb1d58 reply state 0000000071103848 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463904:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463910:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff9273fbd42100) 00010000:00010000:3.0:1787388070.463913:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388070.463915:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787388070.463942:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1811c82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c49 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463956:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1811c97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c49 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.463964:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273fbd42800) 00010000:00010000:3.0:1787388070.463966:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388070.463969:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497400, rc 0) 00000100:00100000:3.0:1787388070.464026:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+10:10534:x1874211952941056:12345-192.168.204.52@tcp:101:touch.500 Request processed in 1137us (1420us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787388070.464034:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:3.0:1787388070.473598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.475735:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952941312 00000100:00100000:2.0:1787388070.475751:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952941312 00000100:00100000:2.0:1787388070.475818:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:2.0:1787388070.475829:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+10:10534:x1874211952941312:12345-192.168.204.52@tcp:36:touch.500 00010000:00010000:2.0:1787388070.475896:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388070.475926:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1811c97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c49 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.475942:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273fbd42800) 00010000:00010000:2.0:1787388070.475952:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388070.476014:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.476029:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.476038:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388070.476158:0:9533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f485c18c reply state 00000000a07e746e transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.476170:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.476176:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:2.0:1787388070.476178:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388070.476181:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388070.476288:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+11:10534:x1874211952941312:12345-192.168.204.52@tcp:36:touch.500 Request processed in 461us (2700us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787388070.476296:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:1.0:1787388070.481631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.481839:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952941440 00000100:00100000:3.0:1787388070.481849:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952941440 00000100:00100000:3.0:1787388070.481923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:3.0:1787388070.481934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+11:10534:x1874211952941440:12345-192.168.204.52@tcp:101:touch.500 00010000:00010000:3.0:1787388070.481957:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388070.481978:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811cac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c50 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.482034:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811cac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c50 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.482049:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811cac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c50 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.482078:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:3.0:1787388070.482081:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388070.482085:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496600, rc 0) 00000100:00100000:3.0:1787388070.482147:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+12:10534:x1874211952941440:12345-192.168.204.52@tcp:101:touch.500 Request processed in 215us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388070.482154:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:1.0:1787388070.488194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.488283:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952941568 00000100:00100000:3.0:1787388070.488294:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952941568 00000100:00100000:3.0:1787388070.488344:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:3.0:1787388070.488353:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874211952941568:12345-192.168.204.52@tcp:8:touch.500 00010000:00080000:2.0:1787388070.489842:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:2.0:1787388070.489880:0:8436:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b1811cb3 00002000:00100000:2.0:1787388070.489893:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74df45bd-a066-4da5-9401-b0a043132784/ffff927401ba9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388070.489913:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 76, return 76 00002000:00080000:2.0:1787388070.489996:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388070.490040:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9273eee85800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388070.490192:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952941568:12345-192.168.204.52@tcp:8:touch.500 Request processed in 1838us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.490202:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:0.0:1787388070.495818:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.495955:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952941696 00000100:00100000:3.0:1787388070.495967:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952941696 00000100:00100000:3.0:1787388070.496154:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:3.0:1787388070.496168:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952941696:12345-192.168.204.52@tcp:2:touch.500 00000100:00080000:1.0:1787388070.496378:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787388070.498086:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1787388070.498097:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000100:00100000:3.0:1787388070.498487:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:0:x1874211952941696:12345-192.168.204.52@tcp:2:touch.500 Request processed in 2317us (2674us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787388070.498508:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:1.0:1787388070.501439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.501662:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952941952 00000100:00100000:3.0:1787388070.501672:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952941952 00000100:00100000:3.0:1787388070.501848:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:3.0:1787388070.501858:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+12:10534:x1874211952941952:12345-192.168.204.52@tcp:35:touch.500 00000100:00100000:3.0:1787388070.502169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+13:10534:x1874211952941952:12345-192.168.204.52@tcp:35:touch.500 Request processed in 311us (738us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787388070.502178:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:1.0:1787388070.513077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.513168:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952942080 00000100:00100000:2.0:1787388070.513179:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952942080 00000100:00100000:2.0:1787388070.513245:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:2.0:1787388070.513255:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+13:10535:x1874211952942080:12345-192.168.204.52@tcp:101:rm.0 00010000:00010000:2.0:1787388070.513279:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388070.513298:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811cba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c57 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.513405:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811cc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.513419:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.513430:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388070.513481:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388070.513484:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388070.513517:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.513563:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811cba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c57 expref: 15 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.513583:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c57 expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388070.514354:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:2.0:1787388070.514358:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388070.514361:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffc00, rc 0) 00000100:00100000:2.0:1787388070.514437:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+14:10535:x1874211952942080:12345-192.168.204.52@tcp:101:rm.0 Request processed in 1181us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.514445:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:1.0:1787388070.518345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388070.518495:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952942336 00000100:00100000:0.0:1787388070.518504:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952942336 00000100:00100000:0.0:1787388070.518576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 34 00000100:00100000:0.0:1787388070.518586:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+14:10535:x1874211952942336:12345-192.168.204.52@tcp:101:rm.0 00010000:00010000:0.0:1787388070.518619:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388070.518657:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388070.518817:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787388070.518965:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811cc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c5e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.518980:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:0.0:1787388070.518983:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388070.518988:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c5e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.519004:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb200, rc 0) 00000100:00100000:0.0:1787388070.519070:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+15:10535:x1874211952942336:12345-192.168.204.52@tcp:101:rm.0 Request processed in 485us (744us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1787388070.519077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 34 00000100:00100000:1.0:1787388070.533777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388070.533871:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952942464 00000100:00100000:0.0:1787388070.533880:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952942464 00000100:00100000:0.0:1787388070.533930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:0.0:1787388070.533939:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+15:10535:x1874211952942464:12345-192.168.204.52@tcp:37:rm.0 00000100:00100000:0.0:1787388070.544222:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+15:10535:x1874211952942464:12345-192.168.204.52@tcp:37:rm.0 Request processed in 10270us (10439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388070.544238:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:1.0:1787388070.548090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.548178:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952942720 00000100:00100000:3.0:1787388070.548189:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952942720 00000100:00100000:3.0:1787388070.548248:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:3.0:1787388070.548259:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+15:10535:x1874211952942720:12345-192.168.204.52@tcp:35:rm.0 00000100:00100000:3.0:1787388070.548479:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+16:10535:x1874211952942720:12345-192.168.204.52@tcp:35:rm.0 Request processed in 221us (400us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787388070.548487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:1.0:1787388070.551317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388070.551527:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952942976 00000100:00100000:0.0:1787388070.551539:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952942976 00000100:00100000:0.0:1787388070.551763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:0.0:1787388070.551775:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+16:10535:x1874211952942976:12345-192.168.204.52@tcp:101:rm.0 00010000:00010000:0.0:1787388070.551818:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388070.551840:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c65 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.551944:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbe00/0x5cb77467b1811cdd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.551959:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbe00/0x5cb77467b1811cdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.551975:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbe00/0x5cb77467b1811cdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388070.551989:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787388070.552140:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c65 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.552159:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbe00/0x5cb77467b1811cdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c65 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.552168:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:0.0:1787388070.552171:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787388070.552175:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbe00, rc 0) 00000100:00100000:0.0:1787388070.552227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952942976:12345-192.168.204.52@tcp:101:rm.0 Request processed in 454us (921us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787388070.552235:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:1.0:1787388070.555222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388070.555308:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952943104 00000100:00100000:2.0:1787388070.555319:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952943104 00000100:00100000:2.0:1787388070.555384:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:2.0:1787388070.555395:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952943104:12345-192.168.204.52@tcp:41:rm.0 00000004:00000024:2.0:1787388070.555452:0:13489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787388070.555576:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952943104:12345-192.168.204.52@tcp:41:rm.0 Request processed in 183us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.555584:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:1.0:1787388070.558849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.558975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952943232 00000100:00100000:3.0:1787388070.558986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952943232 00000100:00100000:3.0:1787388070.559061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:3.0:1787388070.559072:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952943232:12345-192.168.204.52@tcp:101:rm.0 00010000:00010000:3.0:1787388070.559095:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388070.559120:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811ceb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c6c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559196:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559231:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559245:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559259:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559266:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559273:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559379:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559388:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559395:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388070.559433:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787388070.559437:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388070.559455:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559467:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559486:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559493:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559499:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559505:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.559509:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559517:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559529:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:3.0:1787388070.559532:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.559538:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559544:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811cf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559571:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559578:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559583:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559981:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.559985:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.559991:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.560001:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff9273fbd42100) 00010000:00010000:3.0:1787388070.560004:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.560007:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.560013:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811cf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.560044:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811ceb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c6c expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.560071:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c6c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.560079:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:3.0:1787388070.560082:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388070.560084:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:2.0:1787388070.560372:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:10535:x1874211952943232:12345-192.168.204.52@tcp:101:rm.0 Request processed in 1300us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.560387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:1.0:1787388070.563838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.564100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952943488 00000100:00100000:3.0:1787388070.564112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952943488 00000100:00100000:3.0:1787388070.564216:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 38 00000100:00100000:3.0:1787388070.564227:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+19:10535:x1874211952943488:12345-192.168.204.52@tcp:36:rm.0 00010000:00010000:3.0:1787388070.564314:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787388070.564342:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811d00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c6c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564364:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496600/0x5cb77467b1811cac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c50 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564376:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:3.0:1787388070.564387:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811cc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c57 expref: 17 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564395:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:3.0:1787388070.564398:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388070.564419:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564430:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564439:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564448:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564455:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564461:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564585:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564603:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.564612:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388070.564952:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787388070.564963:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359549283137ns, next at 360549280489ns, rc = 0 00010000:00010000:3.0:1787388070.565012:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565021:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565028:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565036:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565043:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565058:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565122:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388070.565139:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565151:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565157:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565164:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.565167:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565174:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565184:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:3.0:1787388070.565187:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787388070.565191:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565198:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b1811d15 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565213:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565218:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565224:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565229:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.565237:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565244:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565253:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:3.0:1787388070.565255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.565258:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565263:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1811d07 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388070.565272:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030571d3d reply state 00000000fc2e198f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565282:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.565289:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff9273fbd42100) 00010000:00010000:3.0:1787388070.565291:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388070.565293:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388070.565369:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952943488:12345-192.168.204.52@tcp:36:rm.0 Request processed in 1142us (1537us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787388070.565377:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 38 00010000:00010000:0.0:1787388070.566488:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388070.566499:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.566540:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388070.566544:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.566560:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.566575:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:0.0:1787388070.566578:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787388070.566583:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.566595:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811d1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388070.566611:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388070.566613:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388070.566615:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388070.569450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.569538:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952943744 00000100:00100000:3.0:1787388070.569556:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952943744 00000100:00100000:2.0:1787388070.569999:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:2.0:1787388070.570013:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952943744:12345-192.168.204.52@tcp:35:rm.0 00000100:00100000:2.0:1787388070.570266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+19:10535:x1874211952943744:12345-192.168.204.52@tcp:35:rm.0 Request processed in 256us (824us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787388070.570274:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:1.0:1787388070.572262:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388070.572328:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944000 00000100:00100000:3.0:1787388070.572336:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944000 00000100:00100000:3.0:1787388070.572389:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 39 00000100:00100000:3.0:1787388070.572398:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+19:10535:x1874211952944000:12345-192.168.204.52@tcp:36:rm.0 00010000:00010000:3.0:1787388070.572459:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787388070.572485:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbe00/0x5cb77467b1811cdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c65 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572507:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1811c7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c42 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572518:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42e00) 00010000:00010000:3.0:1787388070.572547:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811c3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c34 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572562:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273cb9ab100) 00010000:00010000:3.0:1787388070.572568:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388070.572801:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572814:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572824:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572838:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572845:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572851:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572934:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572942:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.572948:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388070.573159:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388070.573174:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573182:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573189:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573195:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.573200:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573207:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573216:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9273fbd42c00) 00010000:00010000:3.0:1787388070.573219:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787388070.573222:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573237:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b1811d31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573255:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573260:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573266:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573271:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388070.573274:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573280:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573286:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273fbd42300) 00010000:00010000:3.0:1787388070.573288:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388070.573291:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573296:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496a00/0x5cb77467b1811d23 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388070.573305:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038b9cb6c reply state 000000004e3b0877 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573315:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388070.573325:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9273fbd42a00) 00010000:00010000:3.0:1787388070.573327:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388070.573330:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388070.573443:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+18:10535:x1874211952944000:12345-192.168.204.52@tcp:36:rm.0 Request processed in 1043us (1185us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787388070.573450:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 39 00010000:00010000:3.0:1787388071.047842:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388071.432244:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971899648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388071.432359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388071.432449:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899648 00000100:00100000:2.0:1787388071.432449:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388071.432461:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899648 00000100:00100000:2.0:1787388071.432462:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971899776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388071.432499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388071.432567:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388071.433144:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899776 00000100:00100000:3.0:1787388071.433149:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899776 00000100:00100000:3.0:1787388071.433179:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787388071.433187:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971899648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388071.433211:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388071.433263:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971899648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388071.433271:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787388071.433286:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787388071.433292:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971899776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388071.433300:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388071.433328:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971899776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388071.433333:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1787388071.433349:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787388071.433373:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36c5180 x1874211971899776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388071.433406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971899776:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787388071.433436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbf480 x1874211971899648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388071.433446:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971899648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388071.945035:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971899904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388071.945153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388071.946450:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971899904 00000100:00100000:0.0:1787388071.946467:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971899904 00000100:00100000:0.0:1787388071.946545:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787388071.946554:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971899904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388071.946589:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388071.946670:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971899904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388071.946768:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787388071.946982:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971899904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388072.075676:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388073.099029:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388073.480053:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971900416:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.480127:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971900160:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.480176:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.480179:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971900928:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.480208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971900672:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.480240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.480252:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971901440:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.480267:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971901184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.480301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.480309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787388073.480318:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971900288:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.480326:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971901696:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.480361:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971900800:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.480362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.480388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.480392:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787388073.480400:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971900032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388073.480424:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971901312:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.480472:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900928 00000100:00100000:1.0:1787388073.480480:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900928 00000100:00100000:1.0:1787388073.480548:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901696 00000100:00100000:1.0:1787388073.480552:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901696 00000100:00100000:1.0:1787388073.480565:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900800 00000100:00100000:1.0:1787388073.480568:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900800 00000100:00100000:1.0:1787388073.480586:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787388073.480593:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971900928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480644:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971900928:12345-0@lo:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.480651:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787388073.480668:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787388073.480674:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971901696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480728:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971901696:12345-0@lo:400:kworker.0 Request processed in 54us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.480734:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787388073.480746:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787388073.480752:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971900800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480777:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971900800:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.480782:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787388073.480799:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901440 00000100:00100000:1.0:1787388073.480802:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901440 00000100:00100000:1.0:1787388073.480821:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901184 00000100:00100000:1.0:1787388073.480823:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901184 00000100:00100000:1.0:1787388073.480832:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900288 00000100:00100000:1.0:1787388073.480839:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900288 00000100:00100000:1.0:1787388073.480849:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901312 00000100:00100000:1.0:1787388073.480851:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901312 00000100:00100000:1.0:1787388073.480862:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787388073.480867:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971901440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480893:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971901440:12345-0@lo:400:kworker.0 Request processed in 26us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.480899:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787388073.480908:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787388073.480913:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971901184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480933:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971901184:12345-0@lo:400:kworker.0 Request processed in 20us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.480938:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787388073.480948:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787388073.480953:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971900288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.480980:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971900288:12345-0@lo:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.480985:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787388073.481009:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787388073.481015:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971901312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.481041:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971901312:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.481046:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787388073.481080:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971900288:0@lo:400:kworker.0 00010000:00080000:1.0:1787388073.481092:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d91f80 x1874211971900800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388073.481114:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971900800:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.481123:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971901312:0@lo:400:kworker.0 00010000:00080000:1.0:1787388073.481131:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d91180 x1874211971900928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388073.481139:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971900928:0@lo:400:kworker.0 00010000:00080000:1.0:1787388073.481147:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d93480 x1874211971901440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388073.481154:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971901440:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.481201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900416 00000100:00100000:1.0:1787388073.481205:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900416 00000100:00100000:1.0:1787388073.481224:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900672 00000100:00100000:1.0:1787388073.481226:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900672 00000100:00100000:1.0:1787388073.481236:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787388073.481241:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971900416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.481274:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971900416:12345-0@lo:400:kworker.0 Request processed in 33us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.481279:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787388073.481288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388073.481293:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971900672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.481329:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971900672:12345-0@lo:400:kworker.0 Request processed in 35us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.481335:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388073.481377:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971900416:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.481392:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388073.481399:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971901824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388073.481425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.481609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.482406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900160 00000100:00100000:3.0:1787388073.482415:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900160 00000100:00100000:3.0:1787388073.482465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787388073.482476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971900160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.482485:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971900544:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.482548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971900160:12345-0@lo:400:kworker.0 Request processed in 75us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.482556:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787388073.482579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.482602:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971901056:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.482626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.482740:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971901952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388073.482769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.482800:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901952 00000100:00100000:1.0:1787388073.482804:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901952 00000100:00100000:1.0:1787388073.482827:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787388073.482834:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971901952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388073.482861:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388073.482897:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971901952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.482904:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787388073.482943:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971901952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388073.486558:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901824 00000100:00100000:0.0:1787388073.486572:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901824 00000100:00100000:0.0:1787388073.486632:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900032 00000100:00100000:0.0:1787388073.486648:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900032 00000100:00100000:0.0:1787388073.486673:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787388073.486698:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971901824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388073.486733:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388073.486789:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388073.486801:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971900032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388073.486816:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388073.486817:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971901824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (5389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388073.486827:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787388073.486861:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971900032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (5251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.486868:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1787388073.487144:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2710700 x1874211971901824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388073.487168:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971901824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787388073.487223:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388073.487230:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388073.487233:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388073.487235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388073.491982:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971901568:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.492462:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971900544 00000100:00100000:3.0:1787388073.492474:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971900544 00000100:00100000:3.0:1787388073.492566:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901056 00000100:00100000:3.0:1787388073.492570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901056 00000100:00100000:3.0:1787388073.492607:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787388073.492618:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971900544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.492648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.492714:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971900544:12345-0@lo:400:kworker.0 Request processed in 98us (10135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388073.492719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971900160:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.492726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787388073.492740:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971900672:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.492749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787388073.492761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971901056:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787388073.492761:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d93b80 x1874211971901184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388073.492776:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971901184:0@lo:400:kworker.0 00010000:00080000:2.0:1787388073.492790:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d90e00 x1874211971901696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388073.492799:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971901696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.492823:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971901056:12345-0@lo:400:kworker.0 Request processed in 64us (10194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.492831:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00010000:00080000:2.0:1787388073.492839:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36c5c00 x1874211971900032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787388073.492865:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388073.492875:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971900032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388073.492889:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971900544:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.492902:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971901056:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.492910:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971901568 00000100:00100000:3.0:1787388073.492916:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971901568 00000100:00100000:3.0:1787388073.492945:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787388073.492953:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971901568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.493009:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971901568:12345-0@lo:400:kworker.0 Request processed in 57us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.493016:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1787388073.493275:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2d91880 x1874211971901568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388073.493285:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971901568:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.817541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388073.817606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388073.817635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388073.817659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388073.817694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388073.817721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388073.817748:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944512 00000100:00100000:3.0:1787388073.817757:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944512 00000100:00100000:3.0:1787388073.817843:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 85 00000100:00100000:3.0:1787388073.817854:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952944512:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.817940:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952944512:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.817949:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 85 00000100:00100000:3.0:1787388073.818142:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944256 00000100:00100000:3.0:1787388073.818146:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944256 00000100:00100000:3.0:1787388073.818176:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944768 00000100:00100000:3.0:1787388073.818185:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944768 00000100:00100000:3.0:1787388073.818204:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944384 00000100:00100000:3.0:1787388073.818207:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944384 00000100:00100000:3.0:1787388073.818222:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944640 00000100:00100000:3.0:1787388073.818224:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944640 00000100:00100000:3.0:1787388073.818239:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 213 00000100:00100000:3.0:1787388073.818245:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+18:2401:x1874211952944256:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.818278:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+18:2401:x1874211952944256:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 33us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.818285:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 213 00000100:00100000:3.0:1787388073.818306:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 214 00000100:00100000:3.0:1787388073.818313:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952944768:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.818337:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952944768:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 26us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.818343:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 214 00000100:00100000:3.0:1787388073.818355:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 215 00000100:00100000:3.0:1787388073.818361:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952944384:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.818382:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952944384:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 22us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.818388:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 215 00000100:00100000:3.0:1787388073.818399:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 216 00000100:00100000:3.0:1787388073.818405:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952944640:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.818426:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952944640:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 22us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.818431:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 216 00000100:00080000:3.0:1787388073.818459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388073.818462:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388073.818465:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388073.818722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944128 00000100:00100000:0.0:1787388073.818728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944128 00000100:00100000:0.0:1787388073.818766:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 336 00000100:00100000:0.0:1787388073.818774:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952944128:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388073.818809:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952944128:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 36us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388073.818816:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 336 00010000:00010000:0.0:1787388074.125510:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787388074.476618:0:13688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787388075.144171:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787388075.522596:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff6a7b5960 00000020:00000080:3.0:1787388075.522613:0:13736:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787388075.522618:0:13736:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787388075.522631:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6a7b7bf0 20000000:00000080:3.0:1787388075.522637:0:13736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9273fbd79000 uarg=0000000000000000 20000000:01000000:3.0:1787388075.522976:0:13736:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787388075.522983:0:13736:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787388075.522989:0:13736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787388075.523862:0:13737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787388075.524153:0:13736:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787388075.530369:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787388075.530424:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787388075.530442:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787388075.530458:0:13736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787388075.530479:0:13736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530500:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530507:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530515:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530521:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530943:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530973:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.530981:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.531019:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.531107:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 23 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.531123:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902080:0@lo:104: 00000100:00100000:3.0:1787388075.531193:0:13736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787388075.531280:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.531288:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.531296:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902208:0@lo:104: 00010000:00010000:3.0:1787388075.531324:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.531332:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 23 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.531340:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902336:0@lo:104: 00010000:00010000:3.0:1787388075.531366:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.531381:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 23 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.531391:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902464:0@lo:104: 00000100:00100000:2.0:1787388075.531391:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787388075.531432:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388075.531471:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388075.531488:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902080 00000100:00100000:2.0:1787388075.531494:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902080 00000100:00100000:2.0:1787388075.531528:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902208 00000100:00100000:2.0:1787388075.531531:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902208 00000100:00100000:2.0:1787388075.531551:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902336 00000100:00100000:2.0:1787388075.531554:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902336 00000100:00100000:2.0:1787388075.531565:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388075.531572:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:13736:x1874211971902080:12345-0@lo:104: 00010000:00010000:2.0:1787388075.531584:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531629:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388075.531636:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+5:13736:x1874211971902080:12345-0@lo:104: Request processed in 64us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388075.531642:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388075.531675:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388075.531705:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:13736:x1874211971902208:12345-0@lo:104: 00010000:00010000:2.0:1787388075.531712:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531739:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388075.531744:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+4:13736:x1874211971902208:12345-0@lo:104: Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388075.531749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787388075.531773:0:13193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787388075.531783:0:13193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:13736:x1874211971902336:12345-0@lo:104: 00010000:00010000:3.0:1787388075.531793:0:13193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.531830:0:13193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787388075.531836:0:13193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:13736:x1874211971902336:12345-0@lo:104: Request processed in 56us (364us total) trans 0 rc 0/0 00010000:00010000:2.0:1787388075.531861:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787388075.531868:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531876:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffe00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388075.531880:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531889:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388075.531896:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388075.531902:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388075.531931:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531937:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388075.531966:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531972:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ffe00/0x5cb77467b1811bfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811c04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531988:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388075.531991:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.531996:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388075.531999:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532013:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388075.532019:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388075.532025:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388075.532040:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532046:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388075.532054:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532061:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafba00/0x5cb77467b1811bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811bf6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532071:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388075.532074:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532079:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388075.532083:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.532091:0:13193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787388075.532093:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388075.532101:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388075.532114:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787388075.532123:0:13736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388075.532131:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532138:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388075.532157:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532164:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafb600/0x5cb77467b1811be1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811be8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.532175:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388075.532177:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388075.532180:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388075.532187:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388075.532193:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388075.532213:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388075.532214:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971902592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388075.532233:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 12 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.532244:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902976:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388075.532252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388075.532415:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902464 00000100:00100000:0.0:1787388075.532421:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902464 00000100:00100000:0.0:1787388075.532453:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787388075.532461:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:13736:x1874211971902464:12345-0@lo:104: 00010000:00010000:0.0:1787388075.532469:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388075.532607:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388075.532614:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971902720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388075.532633:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902592 00000100:00100000:2.0:1787388075.532636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388075.532637:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902592 00010000:00010000:1.0:1787388075.532657:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 24 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.532772:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.532781:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.532801:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971903104:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388075.532895:0:13736:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388075.532918:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902080:0@lo:104: 00000100:00100000:3.0:1787388075.532925:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902208:0@lo:104: 00000100:00100000:3.0:1787388075.532933:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902336:0@lo:104: 00010000:00010000:0.0:1787388075.533105:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787388075.533113:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+3:13736:x1874211971902464:12345-0@lo:104: Request processed in 653us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388075.533119:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1787388075.533138:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388075.533143:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388075.533149:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388075.533153:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388075.533159:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388075.533165:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388075.533170:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388075.533193:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388075.533198:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388075.533207:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388075.533212:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b4400/0x5cb77467b1811bd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1811bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388075.533235:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388075.533237:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388075.533239:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388075.533337:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902720 00000100:00100000:1.0:1787388075.533342:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902720 00010000:00010000:1.0:1787388075.533357:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811bef expref: 25 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388075.533390:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388075.533398:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+25:3646:x1874211971902592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388075.533409:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388075.533414:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 25 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.533425:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 25 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.533439:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafa800/0x5cb77467b1811c04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811bfd expref: 25 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.533452:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388075.533497:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971902592:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388075.533504:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388075.533519:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388075.533525:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3646:x1874211971902720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388075.533532:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388075.533536:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.533546:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.533564:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0030600/0x5cb77467b1811bf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811bef expref: 23 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.533573:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388075.533659:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3646:x1874211971902720:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388075.533665:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388075.533736:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971902720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388075.533746:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971902592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388075.535024:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971903232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388075.535081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388075.535109:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388075.535116:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971902848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388075.535137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1787388075.535668:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787388075.535705:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787388075.536024:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388075.536037:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971903360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787388075.536076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388075.536110:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971903360 00000100:00100000:1.0:1787388075.536117:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971903360 00000100:00100000:1.0:1787388075.536170:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787388075.536179:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971903360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787388075.536201:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787388075.536233:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8960a6, atime: 0x6a8960a6, ctime: 0x6a8960a6, blocks: 0x0 00010000:00010000:1.0:1787388075.536241:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536256:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1787388075.536261:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388075.536268:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536303:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536312:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536319:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536336:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388075.536493:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971903360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 315us (416us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787388075.536500:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787388075.536522:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787388075.536860:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388075.536865:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536875:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388075.536879:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536888:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536916:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536924:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b1811d3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.536943:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388075.536945:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388075.536946:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388075.536982:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971903232 00000100:00100000:1.0:1787388075.536987:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971903232 00010000:00010000:1.0:1787388075.537008:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 22 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388075.537039:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971902848 00000100:00100000:1.0:1787388075.537043:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971902848 00010000:00010000:1.0:1787388075.537055:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 23 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388075.537074:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388075.537080:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3645:x1874211971903232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388075.537091:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388075.537096:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 23 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.537105:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 23 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.537128:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388075.537164:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3645:x1874211971903232:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388075.537170:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388075.537184:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388075.537196:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3645:x1874211971902848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388075.537203:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388075.537207:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 22 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.537216:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 22 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.537227:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fee00/0x5cb77467b1811be8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811be1 expref: 22 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.537237:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388075.537259:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3645:x1874211971902848:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388075.537265:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1787388075.537307:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c2d91180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787388075.537313:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971903360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787388075.537336:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971902848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388075.537345:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971903232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388075.537823:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b5c00/0x5cb77467b1811bda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1811bd3 expref: 20 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.537835:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902464:0@lo:104: 00010000:00010000:2.0:1787388075.538431:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538443:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538459:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538480:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388075.538485:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538492:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538506:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff9273fbd42100) 00010000:00010000:2.0:1787388075.538509:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388075.538513:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538519:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811c90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538536:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538543:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538548:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538553:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388075.538556:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538562:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538581:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9273cb9ab300) 00010000:00010000:2.0:1787388075.538584:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388075.538587:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538592:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811ca5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538611:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538617:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538622:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538627:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388075.538629:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538635:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538642:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff9273fbd42100) 00010000:00010000:2.0:1787388075.538644:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388075.538647:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538651:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811d0e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538675:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538701:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538708:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538714:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388075.538717:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538723:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538732:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9273fbd42a00) 00010000:00010000:2.0:1787388075.538734:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388075.538737:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388075.538743:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811d2a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.539200:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971902976:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388075.539211:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3618700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211971903104:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388075.539242:0:13736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388075.542408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388075.542544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952944896 00000100:00100000:1.0:1787388075.542554:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952944896 00010000:00010000:1.0:1787388075.542607:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 13 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388075.542649:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:1.0:1787388075.542659:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952944896:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388075.542675:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388075.542721:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 13 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.542733:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 13 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.542752:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0030e00/0x5cb77467b1811bcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c26 expref: 13 pid: 6515 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.542768:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388075.542820:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:2404:x1874211952944896:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 163us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388075.542828:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:0.0:1787388075.543280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388075.543358:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945024 00000100:00100000:1.0:1787388075.543363:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945024 00010000:00010000:1.0:1787388075.543380:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388075.543409:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:1.0:1787388075.543428:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:2403:x1874211952945024:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388075.543438:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388075.543443:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543463:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543476:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0031200/0x5cb77467b1811bc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c1f expref: 12 pid: 6514 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543489:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543497:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543514:0:7461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543521:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543527:0:7461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543534:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543540:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388075.543544:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.543552:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.550382:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388075.550410:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388075.550712:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2403:x1874211952945024:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 7289us (7428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388075.550724:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 51 00010000:00010000:3.0:1787388075.552036:0:13736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.552052:0:13736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388075.552059:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1497200/0x5cb77467b1811d38 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388076.170170:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787388076.488254:0:13786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcd107f210 00000020:00000080:1.0:1787388076.488273:0:13786:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787388076.488278:0:13786:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787388076.488286:0:13786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd10814a0 20000000:00000080:1.0:1787388076.488294:0:13786:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9272c36bd000 uarg=0000000000000000 20000000:01000000:1.0:1787388076.488342:0:13786:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787388076.488350:0:13786:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787388076.488357:0:13786:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787388076.491162:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1787388076.491364:0:13786:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1787388076.491483:0:13786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1787388076.491514:0:13786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1787388076.491533:0:13786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1787388076.491546:0:13786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787388076.491571:0:13786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491590:0:13786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491601:0:13786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491608:0:13786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491614:0:13786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491629:0:13786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491636:0:13786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388076.491641:0:13786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491649:0:13786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491663:0:13786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491670:0:13786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.491723:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b5400/0x5cb77467b1811d46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388076.552641:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388076.552671:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971903488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388076.552775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388076.552844:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971903616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388076.552870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388076.552904:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971903488 00000100:00100000:0.0:1787388076.552912:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971903488 00000100:00100000:0.0:1787388076.553052:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971903616 00000100:00100000:0.0:1787388076.553056:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971903616 00000100:00100000:0.0:1787388076.553074:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787388076.553082:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971903488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388076.553124:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388076.553172:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971903488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388076.553180:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787388076.553198:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787388076.553205:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971903616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388076.553214:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388076.553241:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971903616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388076.553247:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787388076.553292:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971903616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388076.553326:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971903488:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787388076.555143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1787388076.679849:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388076.679858:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401ba8000 from 7 10000000:01000000:2.0:1787388076.679863:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388076.679928:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388076.679948:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388076.679977:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388076.680006:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971903744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388076.680080:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388076.680133:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787388076.680262:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971903744 00000100:00100000:0.0:1787388076.680271:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971903744 00000100:00100000:0.0:1787388076.680328:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787388076.680338:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:6517:x1874211971903744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388076.680353:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388076.680367:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811d54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811d4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388076.680392:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811d4d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388076.680415:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811d4d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388076.680448:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbe00, rc 0) 00000100:00100000:0.0:1787388076.680503:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971903744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388076.680510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787388076.680669:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971903744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388076.680723:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.680731:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388076.680801:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971903872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.680832:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.680851:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388076.680970:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971903872 00000100:00100000:0.0:1787388076.680975:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971903872 00000100:00100000:0.0:1787388076.681010:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787388076.681017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971903872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388076.681142:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971903872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388076.681148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787388076.681295:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971903872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.681326:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.681366:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.681395:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388076.682113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904000 00000100:00100000:0.0:1787388076.682120:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904000 00000100:00100000:0.0:1787388076.682264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787388076.682274:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971904000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388076.682411:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971904000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388076.682419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787388076.682512:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.687768:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13799:1874211971904128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.687883:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.687949:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388076.688465:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904128 00000100:00100000:1.0:1787388076.688474:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904128 00000100:00100000:1.0:1787388076.688531:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787388076.688541:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:13799:x1874211971904128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388076.688701:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:13799:x1874211971904128:12345-0@lo:502:llog_process_th.0 Request processed in 162us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388076.688708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787388076.689011:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13799:1874211971904128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388076.689046:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388076.689057:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.689060:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388076.689066:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927401ba8000 00000020:00000080:3.0:1787388076.689069:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787388076.689120:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388076.689122:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.689124:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388076.689135:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388076.689138:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.689139:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787388076.689143:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927401ba8000 00000020:00000080:3.0:1787388076.689145:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787388076.689183:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13799:1874211971904256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.689223:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.689246:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388076.693383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904256 00000100:00100000:1.0:1787388076.693418:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904256 00000100:00100000:1.0:1787388076.693581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787388076.693592:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:13799:x1874211971904256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388076.693899:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:13799:x1874211971904256:12345-0@lo:502:llog_process_th.0 Request processed in 307us (4672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388076.693907:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787388076.694984:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13799:1874211971904256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388076.695026:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388076.695035:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.695038:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787388076.695042:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787388076.695270:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787388076.695289:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388076.695300:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.695311:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388076.695322:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787388076.695324:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eef18800 from 7 10000000:01000000:1.0:1787388076.695327:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388076.695361:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.695369:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.695379:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388076.695532:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388076.695585:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388076.695737:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fbf61f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.695799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904384 00000100:00100000:3.0:1787388076.695806:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904384 00000100:00100000:3.0:1787388076.695886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787388076.695896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:6517:x1874211971904384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388076.695909:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388076.695942:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1497000/0x5cb77467b1811d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811d5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.695971:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1497000/0x5cb77467b1811d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811d5b expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.695982:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1497000/0x5cb77467b1811d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811d5b expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.695991:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497000, rc 0) 00000100:00100000:3.0:1787388076.696035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971904384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.696056:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787388076.696101:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388076.696114:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.696123:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388076.696186:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.696213:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.696228:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.696240:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904512 00000100:00100000:3.0:1787388076.696244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904512 00000100:00100000:3.0:1787388076.696261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787388076.696267:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971904512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.696377:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971904512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.696383:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787388076.697191:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.697595:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.697745:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.697773:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.697799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904640 00000100:00100000:3.0:1787388076.697806:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904640 00000100:00100000:3.0:1787388076.697843:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787388076.697861:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971904640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.700796:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971904640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2926us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.700813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787388076.701879:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971904640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.702379:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13802:1874211971904768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.702584:0:13802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.702826:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c55fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787388076.702887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904768 00000100:00100000:1.0:1787388076.702899:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904768 00000100:00100000:1.0:1787388076.704086:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787388076.704103:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:13802:x1874211971904768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388076.704309:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:13802:x1874211971904768:12345-0@lo:502:llog_process_th.0 Request processed in 212us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388076.704318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787388076.704728:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13802:1874211971904768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388076.704765:0:13802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388076.704775:0:13802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388076.704778:0:13802:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388076.704785:0:13802:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273eef18800 00000020:00000080:2.0:1787388076.704787:0:13802:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388076.704848:0:13802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388076.704852:0:13802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388076.704854:0:13802:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388076.704857:0:13802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388076.704859:0:13802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388076.704861:0:13802:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787388076.704864:0:13802:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273eef18800 00000020:00000080:2.0:1787388076.704865:0:13802:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787388076.704910:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13802:1874211971904896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388076.705892:0:13802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388076.706028:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.706084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971904896 00000100:00100000:3.0:1787388076.706093:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971904896 00000100:00100000:3.0:1787388076.706141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787388076.706149:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:13802:x1874211971904896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.706263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:13802:x1874211971904896:12345-0@lo:502:llog_process_th.0 Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.706271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787388076.706357:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13802:1874211971904896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388076.706385:0:13802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388076.706406:0:13802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388076.706409:0:13802:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388076.706413:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787388076.706718:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787388076.706746:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388076.706757:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.706768:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388076.706779:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787388076.706782:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273eedc0000 from 7 10000000:01000000:3.0:1787388076.706785:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787388076.706814:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.706833:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.706843:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388076.706862:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.706898:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388076.707027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905024 00000100:00100000:2.0:1787388076.707033:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905024 00000100:00100000:2.0:1787388076.707065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787388076.707073:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:6517:x1874211971905024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388076.707082:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388076.707097:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811d69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388076.707119:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811d69 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388076.707131:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811d69 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388076.707140:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe200, rc 0) 00000100:00100000:2.0:1787388076.707168:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971905024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388076.707174:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787388076.707224:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.707240:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388076.707252:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.707261:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388076.707310:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.707336:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.707357:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388076.707776:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905152 00000100:00100000:2.0:1787388076.707781:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905152 00000100:00100000:2.0:1787388076.707810:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787388076.707817:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971905152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388076.708070:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971905152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388076.708078:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787388076.708145:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.708178:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.708219:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.708561:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388076.708739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905280 00000100:00100000:1.0:1787388076.708744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905280 00000100:00100000:1.0:1787388076.708778:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787388076.708785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971905280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388076.708880:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971905280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388076.708887:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787388076.709234:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.710100:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13803:1874211971905408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.710169:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.710240:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388076.710275:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905408 00000100:00100000:1.0:1787388076.710282:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905408 00000100:00100000:1.0:1787388076.710357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787388076.710367:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:13803:x1874211971905408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388076.710506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:13803:x1874211971905408:12345-0@lo:502:llog_process_th.0 Request processed in 140us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388076.710513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787388076.710644:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13803:1874211971905408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388076.710669:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388076.710702:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.710705:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388076.710712:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273eedc0000 00000020:00000080:3.0:1787388076.710715:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787388076.710773:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388076.711093:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.711097:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388076.711101:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388076.711104:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.711106:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787388076.711110:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273eedc0000 00000020:00000080:3.0:1787388076.711112:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787388076.711290:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13803:1874211971905536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.711337:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.712198:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388076.712251:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905536 00000100:00100000:2.0:1787388076.712269:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905536 00000100:00100000:2.0:1787388076.712309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787388076.712318:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:13803:x1874211971905536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388076.712633:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:13803:x1874211971905536:12345-0@lo:502:llog_process_th.0 Request processed in 315us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388076.712642:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787388076.713112:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13803:1874211971905536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388076.713144:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388076.713152:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.713154:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787388076.713158:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787388076.716145:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787388076.716186:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388076.716199:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.716211:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388076.716233:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787388076.716236:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c9714000 from 7 10000000:01000000:1.0:1787388076.716239:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388076.716278:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.716287:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.716298:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388076.716323:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388076.716393:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388076.716552:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fbf619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388076.718533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905664 00000100:00100000:2.0:1787388076.718548:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905664 00000100:00100000:3.0:1787388076.718905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787388076.718926:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:6517:x1874211971905664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388076.718953:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388076.718975:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1496a00/0x5cb77467b1811d7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1811d77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.719017:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1496a00/0x5cb77467b1811d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1811d77 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.719029:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1496a00/0x5cb77467b1811d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1811d77 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388076.719039:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496a00, rc 0) 00000100:00100000:3.0:1787388076.719127:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971905664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.719135:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787388076.719292:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388076.719315:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388076.719325:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388076.719421:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388076.719466:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388076.721801:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fbf619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388076.722160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905792 00000100:00100000:2.0:1787388076.722172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905792 00000100:00100000:2.0:1787388076.722237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787388076.722247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971905792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388076.722995:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971905792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 745us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388076.723005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787388076.723048:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388076.723099:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388076.723166:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388076.723211:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.723246:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971905920 00000100:00100000:3.0:1787388076.723253:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971905920 00000100:00100000:3.0:1787388076.723284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787388076.723291:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971905920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388076.723392:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:6517:x1874211971905920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.723410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787388076.723482:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:6517:1874211971905920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787388076.724574:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388076.726026:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13805:1874211971906048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.726113:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.726161:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388076.726282:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906048 00000100:00100000:0.0:1787388076.726290:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906048 00000100:00100000:0.0:1787388076.726342:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787388076.726351:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:13805:x1874211971906048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388076.726504:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:13805:x1874211971906048:12345-0@lo:502:llog_process_th.0 Request processed in 154us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388076.726513:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787388076.726659:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13805:1874211971906048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388076.726762:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388076.726772:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.726775:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388076.726781:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273c9714000 00000020:00000080:3.0:1787388076.726783:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787388076.726857:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388076.726860:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.726862:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388076.726864:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388076.726867:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.726868:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787388076.726872:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273c9714000 00000020:00000080:3.0:1787388076.726874:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787388076.726910:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13805:1874211971906176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.727053:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388076.727082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906176 00000100:00100000:3.0:1787388076.727086:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906176 00000100:00100000:3.0:1787388076.727112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787388076.727119:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:13805:x1874211971906176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388076.727190:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:13805:x1874211971906176:12345-0@lo:502:llog_process_th.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388076.727197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787388076.727232:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388076.727248:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:13805:1874211971906176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388076.727267:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388076.727272:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388076.727273:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787388076.727276:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787388076.728157:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787388076.728188:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388076.728198:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388076.728210:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787388076.750572:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388077.064169:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971906304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388077.064244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388077.064537:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906304 00000100:00100000:1.0:1787388077.064545:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906304 00000100:00100000:1.0:1787388077.064608:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787388077.064632:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971906304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388077.064666:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388077.064739:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971906304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388077.064746:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787388077.064891:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971906304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388077.192123:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388077.397083:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.397171:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945152 00000100:00100000:3.0:1787388077.397181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945152 00000100:00100000:3.0:1787388077.397241:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 357 00000100:00100000:3.0:1787388077.397252:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:6174:x1874211952945152:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388077.397270:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388077.397301:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1497c00/0x5cb77467b1811d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c73 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388077.397330:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1497c00/0x5cb77467b1811d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c73 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388077.397343:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1497c00/0x5cb77467b1811d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c73 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388077.397353:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497c00, rc 0) 00000100:00100000:3.0:1787388077.397568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952945152:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 316us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.397576:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 357 00000100:00100000:2.0:1787388077.402517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388077.402615:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945280 00000100:00100000:0.0:1787388077.402624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945280 00000100:00100000:0.0:1787388077.402708:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 358 00000100:00100000:0.0:1787388077.402719:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952945280:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388077.402975:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952945280:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 258us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388077.402984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 358 00000100:00100000:0.0:1787388077.406779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.406868:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945408 00000100:00100000:3.0:1787388077.406879:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945408 00000100:00100000:3.0:1787388077.408156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 359 00000100:00100000:3.0:1787388077.408174:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952945408:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388077.408822:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952945408:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 650us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.408834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 359 00000100:00100000:1.0:1787388077.414412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388077.414861:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945536 00000100:00100000:0.0:1787388077.414873:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945536 00000100:00100000:0.0:1787388077.415199:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 360 00000100:00100000:0.0:1787388077.415224:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:10820:x1874211952945536:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388077.415360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:10820:x1874211952945536:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 138us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388077.415369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 360 00000100:00100000:2.0:1787388077.420877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.421083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945664 00000100:00100000:3.0:1787388077.421095:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945664 00000100:00100000:3.0:1787388077.421479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 361 00000100:00100000:3.0:1787388077.421499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:10820:x1874211952945664:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388077.421975:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:10820:x1874211952945664:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 476us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.421985:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 361 00000100:00100000:1.0:1787388077.429132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.429372:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945792 00000100:00100000:3.0:1787388077.429391:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945792 00000100:00100000:3.0:1787388077.429457:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 362 00000100:00100000:3.0:1787388077.429467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:6174:x1874211952945792:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388077.429483:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388077.429501:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1496600/0x5cb77467b1811d8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c7a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388077.429535:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1496600/0x5cb77467b1811d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c7a expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388077.429547:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1496600/0x5cb77467b1811d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c7a expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388077.429556:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496600, rc 0) 00000100:00100000:3.0:1787388077.436177:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952945792:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 6699us (7042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.436190:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 362 00000100:00100000:1.0:1787388077.452107:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388077.452307:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952945920 00000100:00100000:0.0:1787388077.452317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952945920 00000100:00100000:0.0:1787388077.452373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 363 00000100:00100000:0.0:1787388077.452382:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952945920:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388077.452549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952945920:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 166us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388077.452558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 363 00000100:00100000:2.0:1787388077.469040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.469169:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946048 00000100:00100000:3.0:1787388077.469179:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946048 00000100:00100000:3.0:1787388077.469237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 364 00000100:00100000:3.0:1787388077.469248:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952946048:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388077.469433:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:6174:x1874211952946048:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 186us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.469442:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 364 00000100:00100000:1.0:1787388077.483235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.485023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946176 00000100:00100000:3.0:1787388077.485038:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946176 00000100:00100000:3.0:1787388077.485120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 365 00000100:00100000:3.0:1787388077.485131:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:10824:x1874211952946176:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388077.485287:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:10824:x1874211952946176:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 158us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.485296:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 365 00000100:00100000:1.0:1787388077.493842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388077.503169:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946304 00000100:00100000:3.0:1787388077.503182:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946304 00000100:00100000:3.0:1787388077.503615:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 366 00000100:00100000:3.0:1787388077.503627:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:10824:x1874211952946304:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388077.505816:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:10824:x1874211952946304:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 2183us (11978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.505829:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 366 00000040:00080000:0.0:1787388077.773455:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787388077.774253:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787388078.216948:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388078.600134:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388078.600159:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971906432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388078.600227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.600291:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388078.600302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971906560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388078.600305:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906432 00000100:00100000:1.0:1787388078.600312:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906432 00000100:00100000:2.0:1787388078.600336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787388078.600343:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388078.600366:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787388078.600377:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971906432:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388078.600387:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00000024:1.0:1787388078.600404:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388078.600506:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971906432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.600514:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388078.600603:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906560 00000100:00100000:3.0:1787388078.600608:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906560 00000100:00100000:3.0:1787388078.600642:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787388078.600649:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971906560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388078.600700:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388078.600727:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971906688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388078.600739:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971906560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.600745:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787388078.600751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.600765:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906688 00000100:00100000:3.0:1787388078.600769:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906688 00000100:00100000:3.0:1787388078.600813:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787388078.600818:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971906688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388078.600829:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388078.600858:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971906688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.600872:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1787388078.600888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388078.600910:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971906944:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.600937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.600973:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971906560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388078.600987:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388078.600992:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971907072:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.601012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.601030:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971907456:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.601051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.601057:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971907200:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.601073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971907968:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.601082:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.601092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.601100:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971907712:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.601112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:0.0:1787388078.601116:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ff9c4700 x1874211971906432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388078.601119:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971907584:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.601122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388078.601140:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971906432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388078.601190:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907200 00000100:00100000:1.0:1787388078.601194:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907200 00000100:00100000:1.0:1787388078.601216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787388078.601223:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971907200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.601257:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971907200:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.601270:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787388078.601305:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907456 00000100:00100000:1.0:1787388078.601309:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907456 00000100:00100000:1.0:1787388078.602166:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787388078.602175:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971907456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602214:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906944 00000100:00100000:3.0:1787388078.602218:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906944 00000100:00100000:3.0:1787388078.602247:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907072 00000100:00100000:3.0:1787388078.602250:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907072 00000100:00100000:3.0:1787388078.602260:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907968 00000100:00100000:3.0:1787388078.602262:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907968 00000100:00100000:3.0:1787388078.602272:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907712 00000100:00100000:3.0:1787388078.602274:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907712 00000100:00100000:3.0:1787388078.602284:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787388078.602289:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971906944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.602354:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971907200:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602369:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971906944:12345-0@lo:400:kworker.0 Request processed in 79us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388078.602386:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787388078.602398:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971907072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.602412:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971907456:12345-0@lo:400:kworker.0 Request processed in 238us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.602420:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787388078.602460:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787388078.602474:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787388078.602480:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971907968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602510:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971907968:12345-0@lo:400:kworker.0 Request processed in 30us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.602516:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787388078.602526:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787388078.602532:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971907712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602557:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971907712:12345-0@lo:400:kworker.0 Request processed in 26us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.602564:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1787388078.602581:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388078.602585:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388078.602607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787388078.602635:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbea00 x1874211971907968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388078.602645:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971907968:0@lo:400:kworker.0 00010000:00080000:2.0:1787388078.602650:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbd500 x1874211971907712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388078.602656:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971907456:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.602659:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971907712:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602665:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971906944:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.602674:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787388078.602698:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971906816:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602700:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907584 00000100:00100000:3.0:1787388078.602702:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907584 00000100:00100000:3.0:1787388078.602726:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787388078.602728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.602732:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971907584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.602752:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971907328:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.602759:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971907584:12345-0@lo:400:kworker.0 Request processed in 28us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.602771:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787388078.602772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.602789:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971907840:0@lo:400:kworker.0 00000100:00100000:0.0:1787388078.602840:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971907072:12345-0@lo:400:kworker.0 Request processed in 444us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388078.602848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787388078.602883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.602913:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907840 00000100:00080000:3.0:1787388078.603052:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388078.603061:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971906816 00000100:00100000:0.0:1787388078.603067:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971906816 00000100:00100000:3.0:1787388078.603078:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971907584:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.603093:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971907072:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.603101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907840 00000100:00100000:0.0:1787388078.603101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787388078.603112:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971906816:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787388078.603128:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388078.603149:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971907328 00000100:00100000:3.0:1787388078.603152:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971907328 00000100:00100000:3.0:1787388078.603180:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787388078.603187:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971907328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.603218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787388078.603226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971907840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.603750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971907840:12345-0@lo:400:kworker.0 Request processed in 523us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.603757:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:1.0:1787388078.603766:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c57100 x1874211971906688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388078.603840:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971906688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388078.603945:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971907328:12345-0@lo:400:kworker.0 Request processed in 756us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388078.603949:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971906816:12345-0@lo:400:kworker.0 Request processed in 836us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.603956:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787388078.603966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:3.0:1787388078.603978:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388078.604015:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971907328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.604026:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971907840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.604095:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971906816:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.934139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388078.934186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388078.934218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388078.934299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388078.934336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388078.935468:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946816 00000100:00100000:1.0:1787388078.935481:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946816 00000100:00100000:1.0:1787388078.935552:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 88 00000100:00100000:1.0:1787388078.935574:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952946816:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388078.935647:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952946816:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 86us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.935655:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 88 00000100:00100000:1.0:1787388078.935821:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946432 00000100:00100000:1.0:1787388078.935826:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946432 00000100:00100000:1.0:1787388078.935852:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 368 00000100:00100000:1.0:1787388078.935859:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952946432:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388078.935901:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952946432:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 42us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.935908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 368 00000100:00080000:1.0:1787388078.935980:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388078.942181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388078.943008:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946560 00000100:00100000:3.0:1787388078.943021:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946560 00000100:00100000:3.0:1787388078.943084:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947072 00000100:00100000:3.0:1787388078.943087:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947072 00000100:00100000:3.0:1787388078.943106:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946688 00000100:00100000:3.0:1787388078.943109:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946688 00000100:00100000:3.0:1787388078.943129:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 223 00000100:00100000:3.0:1787388078.943138:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952946560:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388078.943219:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952946560:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 82us (9092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.943227:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 223 00000100:00100000:3.0:1787388078.943242:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 224 00000100:00100000:3.0:1787388078.943249:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952947072:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388078.943284:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952947072:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 37us (9065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.943290:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 224 00000100:00100000:3.0:1787388078.943301:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 225 00000100:00100000:3.0:1787388078.943437:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952946688:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388078.943464:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952946688:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 157us (9128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388078.943471:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 225 00000100:00080000:3.0:1787388078.943508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388078.943512:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388078.944476:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952946944 00000100:00100000:2.0:1787388078.945088:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952946944 00000100:00100000:2.0:1787388078.945149:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 226 00000100:00100000:2.0:1787388078.945159:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952946944:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388078.945218:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952946944:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 60us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.945226:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 226 00000100:00080000:3.0:1787388078.945292:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787388079.242176:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388080.263894:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787388081.162699:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1787388081.287995:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388081.672100:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388081.672130:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971908096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388081.672200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388081.672708:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971908224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388081.672745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388081.672925:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908096 00000100:00100000:1.0:1787388081.672934:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908096 00000100:00100000:1.0:1787388081.672990:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908224 00000100:00100000:1.0:1787388081.672994:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908224 00000100:00100000:1.0:1787388081.673015:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787388081.673025:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971908096:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388081.673058:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787388081.673069:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971908224:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388081.674176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787388081.674392:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388081.674482:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971908096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1456us (2279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388081.674503:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388081.674958:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971908096:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388081.679288:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388081.679419:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971908224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6348us (6670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388081.679445:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787388081.679593:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787388081.679599:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c2d91180, transno 4294967301 00000100:00100000:0.0:1787388081.679632:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971908224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388082.185393:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971908352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388082.185477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388082.185625:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908352 00000100:00100000:1.0:1787388082.185634:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908352 00000100:00100000:1.0:1787388082.185732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787388082.185742:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971908352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388082.185774:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388082.185844:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971908352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388082.185852:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787388082.186111:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971908352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388082.314124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388083.336731:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388083.720041:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.720114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.720168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971909248:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.720193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.720214:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971909760:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.720237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720360:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971908480:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720419:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971908992:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720457:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971909504:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720490:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971910016:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720528:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787388083.720534:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971908608:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720569:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971909120:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720611:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971909632:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.720653:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908480 00000100:00100000:0.0:1787388083.720672:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908480 00000100:00100000:0.0:1787388083.720737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787388083.720746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971908480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720806:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971908480:12345-0@lo:400:kworker.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.720813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787388083.720847:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908736 00000100:00100000:0.0:1787388083.720850:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908736 00000100:00100000:0.0:1787388083.720867:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908992 00000100:00100000:0.0:1787388083.720870:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908992 00000100:00100000:0.0:1787388083.720882:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787388083.720888:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971908736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720919:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971908736:12345-0@lo:400:kworker.0 Request processed in 30us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.720925:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787388083.720936:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787388083.720942:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971908992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.720967:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971908992:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.720973:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787388083.721005:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971908480:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.721018:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971908992:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.721079:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971908864:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.721106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.721123:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971909376:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.721154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.721166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971909888:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.721185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.721212:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909760 00000100:00100000:0.0:1787388083.721216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909760 00000100:00100000:0.0:1787388083.721244:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909504 00000100:00100000:0.0:1787388083.721246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909504 00000100:00100000:0.0:1787388083.721256:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908608 00000100:00100000:2.0:1787388083.721462:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.721484:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909632 00000100:00100000:2.0:1787388083.721487:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909632 00000100:00100000:2.0:1787388083.721506:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971908864 00000100:00100000:2.0:1787388083.721508:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908864 00000100:00100000:2.0:1787388083.721519:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909376 00000100:00100000:2.0:1787388083.721522:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909376 00000100:00100000:2.0:1787388083.721535:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787388083.721542:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971909760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.721582:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971909760:12345-0@lo:400:kworker.0 Request processed in 41us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.721588:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787388083.721730:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787388083.721745:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971909504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.721786:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971909504:12345-0@lo:400:kworker.0 Request processed in 43us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.721805:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787388083.721819:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787388083.721826:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971909632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.721853:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971909632:12345-0@lo:400:kworker.0 Request processed in 28us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.721859:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787388083.721871:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787388083.721877:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971908864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.721908:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971908864:12345-0@lo:400:kworker.0 Request processed in 32us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.721915:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787388083.721926:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787388083.721932:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971909376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.721958:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971909376:12345-0@lo:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388083.722235:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909248 00000100:00100000:3.0:1787388083.722240:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909248 00000100:00100000:3.0:1787388083.722280:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910016 00000100:00100000:3.0:1787388083.722283:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910016 00000100:00100000:3.0:1787388083.722298:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909120 00000100:00100000:3.0:1787388083.722300:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909120 00000100:00100000:3.0:1787388083.722314:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971909888 00000100:00100000:3.0:1787388083.722317:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971909888 00000100:00100000:3.0:1787388083.722331:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787388083.722338:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971909248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.722376:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971909248:12345-0@lo:400:kworker.0 Request processed in 39us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388083.722383:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787388083.722395:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787388083.722410:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971910016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.722443:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971910016:12345-0@lo:400:kworker.0 Request processed in 34us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388083.722449:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787388083.722459:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787388083.722464:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971909120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.722487:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971909120:12345-0@lo:400:kworker.0 Request processed in 23us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388083.722492:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787388083.722502:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787388083.722508:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971909888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.722531:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971909888:12345-0@lo:400:kworker.0 Request processed in 24us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388083.722537:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787388083.722551:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388083.722554:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388083.722557:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388083.722559:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388083.722830:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971908608 00000100:00100000:0.0:1787388083.722864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787388083.722871:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971908608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.722905:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971908608:12345-0@lo:400:kworker.0 Request processed in 35us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.722912:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787388083.722960:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971908864:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.722972:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971909376:0@lo:400:kworker.0 00010000:00080000:0.0:1787388083.722986:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b5f80 x1874211971909888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388083.722996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971909888:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.723019:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388083.723026:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971910272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388083.723059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.723088:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910272 00000100:00100000:0.0:1787388083.723091:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910272 00000100:00100000:0.0:1787388083.723112:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787388083.723118:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971910272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388083.723152:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388083.723185:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971910272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.723191:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787388083.723221:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971910272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388083.723353:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787388083.723439:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971908608:0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.723452:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971909120:0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.723464:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971909632:0@lo:400:kworker.0 00010000:00080000:3.0:1787388083.723477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa84e00 x1874211971909504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388083.723487:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971909504:0@lo:400:kworker.0 00010000:00080000:3.0:1787388083.723512:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b7b80 x1874211971910016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388083.723520:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971910016:0@lo:400:kworker.0 00000100:00100000:3.0:1787388083.723537:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388083.723542:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d0f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971910144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388083.723569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.723823:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971910400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388083.723849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.723877:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910144 00000100:00100000:2.0:1787388083.723881:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910144 00000100:00100000:2.0:1787388083.723906:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910400 00000100:00100000:2.0:1787388083.723909:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910400 00000100:00100000:2.0:1787388083.723921:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388083.723934:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971910144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388083.723953:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388083.724047:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787388083.724056:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971910400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388083.724065:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388083.724095:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971910400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.724101:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787388083.726673:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971910144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2727us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.726706:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1787388083.726786:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36c5f80 x1874211971910400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388083.726821:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971910400:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787388083.726940:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273d0f5ed80 x1874211971910144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388083.726954:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d0f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971910144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388083.727064:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971909248:0@lo:400:kworker.0 00010000:00080000:1.0:1787388083.727079:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36b4e00 x1874211971909760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388083.727089:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971909760:0@lo:400:kworker.0 00000100:00100000:3.0:1787388084.054756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388084.055120:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947328 00000100:00100000:0.0:1787388084.055130:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947328 00000100:00100000:0.0:1787388084.055267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 233 00000100:00100000:0.0:1787388084.055278:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952947328:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388084.055365:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952947328:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 89us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388084.055373:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 233 00000100:00080000:3.0:1787388084.057951:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388084.058647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388084.058780:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947584 00000100:00100000:0.0:1787388084.058800:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947584 00000100:00100000:0.0:1787388084.058883:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 93 00000100:00100000:0.0:1787388084.058894:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952947584:12345-192.168.204.52@tcp:400:kworker.0 00000100:00080000:2.0:1787388084.058999:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388084.061930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388084.061976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388084.062093:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947840 00000100:00100000:2.0:1787388084.062103:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947840 00000100:00100000:2.0:1787388084.062186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 234 00000100:00100000:2.0:1787388084.062196:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952947840:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388084.062287:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952947840:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 93us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388084.062295:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 234 00000100:00100000:3.0:1787388084.062536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947200 00000100:00100000:3.0:1787388084.062746:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947200 00000100:00100000:3.0:1787388084.062805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 370 00000100:00100000:3.0:1787388084.062812:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952947200:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388084.062852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952947200:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 40us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388084.062858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 370 00000100:00080000:1.0:1787388084.066495:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388084.066616:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952947584:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 7717us (7968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388084.066631:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 93 00000100:00100000:1.0:1787388084.066906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388084.066938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388084.067260:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947456 00000100:00100000:0.0:1787388084.067270:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947456 00000100:00100000:3.0:1787388084.067282:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947712 00000100:00100000:3.0:1787388084.067289:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947712 00000100:00080000:1.0:1787388084.067353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388084.067357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388084.067492:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 235 00000100:00100000:0.0:1787388084.067502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952947456:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388084.067580:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952947456:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 79us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388084.067588:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 235 00000100:00100000:0.0:1787388084.067601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 236 00000100:00100000:0.0:1787388084.067607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952947712:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388084.067630:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952947712:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388084.067636:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 236 00010000:00010000:0.0:1787388084.360217:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388085.384810:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388086.409818:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388086.792213:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388086.792242:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971910528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388086.792316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388086.792381:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910528 00000100:00100000:1.0:1787388086.792390:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910528 00000100:00100000:1.0:1787388086.792447:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388086.792456:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971910528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388086.792487:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388086.792533:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971910528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388086.792541:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787388086.792562:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388086.792602:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971910528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388086.797221:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971910656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388086.797302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388086.797390:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910656 00000100:00100000:2.0:1787388086.797400:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910656 00000100:00100000:2.0:1787388086.797463:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787388086.797473:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971910656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388086.797493:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388086.803112:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971910656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5634us (5802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388086.803128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787388086.803169:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388086.805286:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971910656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388087.304339:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388087.304364:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971910784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388087.304427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388087.304706:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910784 00000100:00100000:0.0:1787388087.304715:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910784 00000100:00100000:0.0:1787388087.304783:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787388087.304794:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971910784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388087.304827:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388087.304883:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971910784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388087.304890:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787388087.305193:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eedd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971910784:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388087.436022:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388088.008322:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787388088.009474:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787388088.456073:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388088.841114:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971910912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388088.841189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.841272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971910912 00000100:00100000:2.0:1787388088.841280:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971910912 00000100:00100000:2.0:1787388088.841325:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787388088.841333:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971910912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388088.841366:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388088.841411:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971910912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.841418:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787388088.841462:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971910912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388088.841817:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971911424:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.841856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388088.841946:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971911040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388088.841977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388088.842014:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971911552:0@lo:400:kworker.0 00000100:00100000:0.0:1787388088.842042:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911040 00000100:00100000:0.0:1787388088.842046:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911040 00000100:00100000:0.0:1787388088.842083:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787388088.842090:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971911040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388088.842111:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388088.842144:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971911040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388088.842150:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1787388088.842183:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388088.843140:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971911936:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.843179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.843197:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971912448:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.843237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.843391:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971911168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388088.843428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.843470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971911680:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.843501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.843518:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971912192:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.843561:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911936 00000100:00100000:1.0:1787388088.843567:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911936 00000100:00100000:1.0:1787388088.843609:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787388088.843616:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971911936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.843654:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971911936:12345-0@lo:400:kworker.0 Request processed in 39us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.843660:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1787388088.843718:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388088.843729:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911680 00000100:00100000:1.0:1787388088.843732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911680 00000100:00100000:1.0:1787388088.843755:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787388088.843760:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971911680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.843795:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971911680:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.843801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787388088.843929:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971911296:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.843962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.843986:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971911808:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.844007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.844022:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971912320:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.844047:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911296 00000100:00100000:1.0:1787388088.844050:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911296 00000100:00100000:1.0:1787388088.844073:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787388088.844078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971911296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.844117:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971911296:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.844123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787388088.844147:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911808 00000100:00100000:1.0:1787388088.844150:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911808 00000100:00100000:1.0:1787388088.844174:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787388088.844180:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971911808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.844207:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971911808:12345-0@lo:400:kworker.0 Request processed in 27us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.844212:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1787388088.844228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388088.844640:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911168 00000100:00100000:0.0:1787388088.844646:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911168 00000100:00100000:0.0:1787388088.844722:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787388088.844731:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eedd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971911168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388088.844746:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388088.844788:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eedd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971911168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388088.844794:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787388088.845367:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388088.850408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.850411:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971911936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.853570:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911424 00000100:00100000:3.0:1787388088.853584:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911424 00000100:00100000:3.0:1787388088.853661:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912448 00000100:00100000:3.0:1787388088.853676:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912448 00000100:00100000:3.0:1787388088.853740:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787388088.853749:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971911424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.853835:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971911424:12345-0@lo:400:kworker.0 Request processed in 87us (11978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388088.853843:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787388088.853859:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787388088.853866:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971912448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.853896:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971912448:12345-0@lo:400:kworker.0 Request processed in 31us (10659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388088.853902:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1787388088.853940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388088.854250:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971911424:0@lo:400:kworker.0 00010000:00080000:2.0:1787388088.854267:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bf480 x1874211971912448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388088.854278:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971912448:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.855062:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971912704:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.855110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787388088.855147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c36c5f80 x1874211971911168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388088.855164:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912192 00000100:00100000:1.0:1787388088.855168:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971911168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388088.855182:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912192 00000100:00100000:1.0:1787388088.855184:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971911680:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.855219:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912704 00000100:00100000:1.0:1787388088.855223:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912704 00000100:00100000:2.0:1787388088.855239:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787388088.855249:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971912192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.855274:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787388088.855313:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971912192:12345-0@lo:400:kworker.0 Request processed in 66us (4912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.855320:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:2.0:1787388088.855340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388088.855352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.855386:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971911296:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.855399:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971911808:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.855427:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912320 00000100:00100000:2.0:1787388088.855431:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912320 00000100:00100000:3.0:1787388088.855448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.855480:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971912704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.855516:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971912704:12345-0@lo:400:kworker.0 Request processed in 43us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.855532:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1787388088.855567:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5fb80 x1874211971912192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388088.855576:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971912192:0@lo:400:kworker.0 00010000:00080000:1.0:1787388088.855586:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa6fb80 x1874211971912704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388088.855593:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971912704:0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.867069:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971912064:0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.867136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388088.868473:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971911552 00000100:00100000:0.0:1787388088.868485:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971911552 00000100:00100000:2.0:1787388088.868616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787388088.868631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971912320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.868736:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971912320:12345-0@lo:400:kworker.0 Request processed in 110us (13382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.868744:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787388088.868762:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787388088.868769:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971911552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.868800:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971911552:12345-0@lo:400:kworker.0 Request processed in 32us (13354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.868805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787388088.872670:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971912576:0@lo:400:kworker.0 00000100:00100000:0.0:1787388088.874526:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912064 00000100:00100000:0.0:1787388088.874539:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912064 00000100:00100000:0.0:1787388088.874649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787388088.874661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971912064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.874672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388088.874746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971912064:12345-0@lo:400:kworker.0 Request processed in 88us (7610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388088.874767:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:3.0:1787388088.874771:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbd500 x1874211971911040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388088.874793:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971911040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388088.874808:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912576 00000100:00100000:3.0:1787388088.874811:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971911552:0@lo:400:kworker.0 00000100:00100000:0.0:1787388088.874814:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912576 00000100:00100000:3.0:1787388088.874843:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971912064:0@lo:400:kworker.0 00000100:00100000:0.0:1787388088.874844:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787388088.874857:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971912576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388088.874903:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971912576:12345-0@lo:400:kworker.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00080000:3.0:1787388088.874904:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787388088.874929:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bfb80 x1874211971912576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388088.874952:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971912576:0@lo:400:kworker.0 00000100:00100000:0.0:1787388088.874988:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787388088.875063:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971912320:0@lo:400:kworker.0 00000100:00100000:1.0:1787388089.180300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388089.180501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388089.180596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388089.180651:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952947968 00000100:00100000:2.0:1787388089.180661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952947968 00000100:00100000:2.0:1787388089.180775:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 372 00000100:00100000:2.0:1787388089.180787:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952947968:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388089.180887:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952947968:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 101us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388089.180900:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 372 00000100:00100000:1.0:1787388089.181649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388089.181958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948224 00000100:00100000:0.0:1787388089.181966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948224 00000100:00100000:0.0:1787388089.185373:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948480 00000100:00100000:0.0:1787388089.185389:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948480 00000100:00100000:1.0:1787388089.186040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388089.186087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388089.186114:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948352 00000100:00100000:1.0:1787388089.186119:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948352 00000100:00100000:3.0:1787388089.186289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948096 00000100:00100000:3.0:1787388089.186294:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948096 00000100:00100000:3.0:1787388089.186306:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948608 00000100:00100000:3.0:1787388089.186309:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948608 00000100:00080000:2.0:1787388089.188337:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388089.188348:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388089.188352:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388089.188385:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 243 00000100:00100000:2.0:1787388089.188407:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952948224:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388089.188517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952948224:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 122us (8016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388089.188526:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 243 00000100:00100000:2.0:1787388089.188673:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 244 00000100:00100000:2.0:1787388089.188715:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952948096:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388089.188750:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952948096:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 71us (7118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388089.188757:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 244 00000100:00080000:2.0:1787388089.188853:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388089.189194:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 245 00000100:00100000:0.0:1787388089.189203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952948480:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388089.189243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952948480:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 42us (8647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388089.189250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 245 00000100:00100000:1.0:1787388089.197090:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 98 00000100:00100000:1.0:1787388089.197109:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952948352:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388089.197194:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952948352:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 92us (11160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388089.197202:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 98 00000100:00100000:3.0:1787388089.198267:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 246 00000100:00100000:3.0:1787388089.198279:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952948608:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388089.198345:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952948608:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 68us (12257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388089.198353:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 246 00010000:00010000:1.0:1787388089.480779:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388090.504082:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388091.529327:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388091.913173:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971912832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388091.913381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388091.913810:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388091.913820:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971912960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388091.913849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388091.920444:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912832 00000100:00100000:2.0:1787388091.920461:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912832 00000100:00100000:2.0:1787388091.920604:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971912960 00000100:00100000:2.0:1787388091.920608:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971912960 00000100:00080000:3.0:1787388091.920672:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388091.923217:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388091.923250:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971912832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388091.923287:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388091.923381:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971912832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (10000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388091.923388:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388091.923407:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787388091.923414:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971912960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388091.923441:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388091.923468:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971912960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (9618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388091.923474:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787388091.923586:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971912960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388091.923603:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971912832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388092.424539:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971913088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388092.424632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388092.424779:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913088 00000100:00100000:0.0:1787388092.424788:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913088 00000100:00100000:0.0:1787388092.424843:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787388092.424852:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971913088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388092.426186:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388092.426277:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971913088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1423us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388092.426286:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787388092.426854:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971913088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388092.555474:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388093.576402:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388093.960004:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388093.960043:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971913216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388093.960128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.960189:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971913600:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.960246:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971913344:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.960287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388093.960311:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971913856:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.960404:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971914112:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.960457:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971914624:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388093.960494:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913216 00000100:00100000:3.0:1787388093.960503:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787388093.960503:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913216 00000100:00100000:3.0:1787388093.960511:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971913728:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388093.960548:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913600 00000100:00100000:2.0:1787388093.960553:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913600 00000100:00100000:3.0:1787388093.960558:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971914240:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.960574:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787388093.960582:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971913216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388093.960625:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388093.960671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388093.960702:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971913216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.960711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787388093.960718:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971914752:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.960731:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787388093.960742:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971913600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388093.960785:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971913600:12345-0@lo:400:kworker.0 Request processed in 45us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.960790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971913216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388093.960796:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787388093.960819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.960822:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971913600:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.960846:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971914368:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960862:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913856 00000100:00100000:3.0:1787388093.960866:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913856 00000100:00100000:2.0:1787388093.960874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.960894:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787388093.960901:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971913856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.960934:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971913856:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.960940:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787388093.960967:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914624 00000100:00100000:3.0:1787388093.960971:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914624 00000100:00100000:3.0:1787388093.961004:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913728 00000100:00100000:3.0:1787388093.961007:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913728 00000100:00100000:3.0:1787388093.961018:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914240 00000100:00100000:3.0:1787388093.961020:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914240 00000100:00100000:3.0:1787388093.961030:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914368 00000100:00100000:3.0:1787388093.961032:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914368 00000100:00100000:1.0:1787388093.961125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913344 00000100:00100000:1.0:1787388093.961130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913344 00000100:00100000:1.0:1787388093.961160:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787388093.961174:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971913344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.961211:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971913344:12345-0@lo:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.961218:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787388093.961238:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971914880:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.961270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.961299:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914112 00000100:00100000:1.0:1787388093.961303:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914112 00000100:00100000:2.0:1787388093.961307:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971913344:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.961322:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971913856:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.961329:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914752 00000100:00100000:1.0:1787388093.961334:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914752 00000100:00100000:2.0:1787388093.961336:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787388093.961346:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971913472:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.961349:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914880 00000100:00100000:1.0:1787388093.961353:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914880 00000100:00100000:1.0:1787388093.961376:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787388093.961377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.961387:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971914112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.961400:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971913984:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.961428:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.961438:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971914112:12345-0@lo:400:kworker.0 Request processed in 52us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.961443:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971914496:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.961449:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388093.961465:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913984 00000100:00100000:2.0:1787388093.961467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.961470:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913984 00000100:00100000:2.0:1787388093.961479:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971915008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388093.961493:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388093.961504:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.961505:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971914752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.961532:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915008 00000100:00100000:2.0:1787388093.961537:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915008 00000100:00100000:1.0:1787388093.961544:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971914752:12345-0@lo:400:kworker.0 Request processed in 42us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.961552:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388093.961568:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787388093.961580:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787388093.961581:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971915008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388093.961605:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971914880:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787388093.961613:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388093.961650:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971914880:12345-0@lo:400:kworker.0 Request processed in 59us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.961657:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787388093.961692:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388093.961700:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971913984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.961731:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971913984:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.961737:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388093.961781:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971913984:0@lo:400:kworker.0 00010000:00080000:1.0:1787388093.961793:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa4c700 x1874211971915008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.961805:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971915008:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787388093.961815:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffaed500 x1874211971914880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.961822:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971914880:0@lo:400:kworker.0 00000100:00080000:1.0:1787388093.961856:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388093.961860:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388093.961862:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388093.961864:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787388093.961879:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffaefb80 x1874211971914752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.961887:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971914752:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.961895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971914112:0@lo:400:kworker.0 00000100:00100000:0.0:1787388093.962568:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388093.962581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971915136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388093.962628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388093.962672:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915136 00000100:00100000:2.0:1787388093.962697:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971915008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1119us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.962706:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787388093.962716:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915136 00000100:00100000:2.0:1787388093.962742:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971913472 00000100:00100000:2.0:1787388093.962747:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971913472 00000100:00100000:0.0:1787388093.962755:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787388093.962765:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971915136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388093.962768:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971914496 00000100:00100000:2.0:1787388093.962772:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971914496 00002000:00000024:0.0:1787388093.962779:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787388093.962791:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388093.962810:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787388093.962819:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971914624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388093.962824:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971915136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388093.962830:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1787388093.962863:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa85c00 x1874211971915136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388093.962872:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971914624:12345-0@lo:400:kworker.0 Request processed in 53us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.962879:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787388093.962894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787388093.962899:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971915136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388093.962914:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971913728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.962942:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971913728:12345-0@lo:400:kworker.0 Request processed in 31us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.962955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787388093.962974:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787388093.962985:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971914240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.962994:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787388093.963003:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971914368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388093.963028:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971914240:12345-0@lo:400:kworker.0 Request processed in 45us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388093.963036:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787388093.963048:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971914368:12345-0@lo:400:kworker.0 Request processed in 46us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388093.963055:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787388093.963063:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971913472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.963427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:2.0:1787388093.963457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffaec700 x1874211971914368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388093.963467:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971914368:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.963485:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787388093.963491:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971914496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.963521:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971914496:12345-0@lo:400:kworker.0 Request processed in 31us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.963527:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787388093.963545:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971914496:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.964515:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971913728:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.964531:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971914240:0@lo:400:kworker.0 00010000:00080000:1.0:1787388093.964544:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffaee680 x1874211971914624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.964567:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971914624:0@lo:400:kworker.0 00000100:00100000:0.0:1787388093.964731:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971913472:12345-0@lo:400:kworker.0 Request processed in 1668us (3355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388093.964740:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787388093.964783:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971913472:0@lo:400:kworker.0 00000100:00100000:0.0:1787388094.300989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388094.301096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388094.301127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388094.301210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948736 00000100:00100000:3.0:1787388094.301221:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948736 00000100:00100000:3.0:1787388094.301274:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 374 00000100:00100000:3.0:1787388094.301284:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952948736:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388094.301362:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952948736:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388094.301372:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 374 00000100:00100000:2.0:1787388094.306098:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948864 00000100:00100000:2.0:1787388094.306115:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948864 00000100:00100000:3.0:1787388094.306181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952948992 00000100:00100000:3.0:1787388094.306187:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952948992 00000100:00100000:3.0:1787388094.306242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 253 00000100:00100000:3.0:1787388094.306256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952948992:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388094.306351:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952948992:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 99us (5222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388094.306361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 254 00000100:00100000:2.0:1787388094.306373:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952948864:12345-192.168.204.52@tcp:400:kworker.0 00000100:00080000:1.0:1787388094.306397:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388094.306402:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388094.306413:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952948864:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 42us (5434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388094.321500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 253 00000100:00100000:0.0:1787388094.321957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388094.321998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388094.322033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388094.322074:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949248 00000100:00100000:0.0:1787388094.322085:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949248 00000100:00100000:1.0:1787388094.322114:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949120 00000100:00080000:0.0:1787388094.322121:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388094.322122:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949120 00000100:00100000:1.0:1787388094.322184:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:1.0:1787388094.322195:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2400:x1874211952949120:12345-192.168.204.52@tcp:9:kworker.0 00000020:00000080:1.0:1787388094.322237:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811cb3 00000100:00080000:1.0:1787388094.322246:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9273eee85800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388094.322288:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787388094.322454:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+2:2400:x1874211952949120:12345-192.168.204.52@tcp:9:kworker.0 Request processed in 261us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388094.322462:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 29 00010000:00010000:1.0:1787388094.322481:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388094.322490:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388094.322874:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 254 00000100:00100000:1.0:1787388094.323069:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949376 00000100:00100000:1.0:1787388094.323077:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949376 00000100:00100000:1.0:1787388094.323172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 255 00000100:00100000:1.0:1787388094.323181:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952949376:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388094.323245:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952949376:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 64us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388094.323252:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 255 00000100:00080000:2.0:1787388094.323496:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388094.332389:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 256 00000100:00100000:1.0:1787388094.332417:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952949248:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388094.332700:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952949248:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 297us (10700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388094.332721:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 256 00010000:00010000:1.0:1787388094.600497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388095.625891:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388096.648087:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388097.032192:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388097.032215:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971915264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388097.032285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388097.032347:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915264 00000100:00100000:3.0:1787388097.032354:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915264 00000100:00100000:3.0:1787388097.032402:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388097.032412:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971915264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388097.032443:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388097.032484:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971915264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388097.032491:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787388097.032510:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388097.032555:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971915264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388097.032773:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971915392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388097.032799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388097.035108:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915392 00000100:00100000:2.0:1787388097.035121:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915392 00000100:00100000:2.0:1787388097.035302:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787388097.035312:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971915392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388097.035335:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388097.035407:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971915392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388097.035414:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787388097.035455:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388097.039729:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971915392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388097.543857:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971915520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388097.543936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388097.544300:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915520 00000100:00100000:3.0:1787388097.544309:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915520 00000100:00100000:3.0:1787388097.544367:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787388097.544378:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971915520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388097.544438:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388097.544590:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971915520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388097.544598:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787388097.544872:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971915520:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388097.673488:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388098.252389:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787388098.252913:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388098.699089:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388099.079851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971915776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388099.079851:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971915648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388099.079974:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971915904:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.081737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.081816:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971916160:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.081876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.081901:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971916672:0@lo:400:kworker.0 00000100:00100000:3.0:1787388099.082240:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915648 00000100:00100000:3.0:1787388099.082249:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915648 00000100:00100000:3.0:1787388099.082306:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787388099.082316:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971915648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388099.082346:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388099.082391:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971915648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388099.082400:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1787388099.082481:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388099.083276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388099.083381:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971916288:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.083397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.083427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971917184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.083435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.083465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388099.083468:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971916800:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.083520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787388099.083528:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbea00 x1874211971915648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388099.083543:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971917312:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.083550:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971915648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388099.083572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.083589:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971916032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.083613:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916288 00000100:00100000:1.0:1787388099.083620:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916288 00000100:00100000:0.0:1787388099.083621:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.083647:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971916544:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.083658:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917184 00000100:00100000:1.0:1787388099.083663:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917184 00000100:00100000:0.0:1787388099.083675:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388099.083713:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916800 00000100:00100000:0.0:1787388099.083718:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971917056:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.083719:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916800 00000100:00100000:1.0:1787388099.083739:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916032 00000100:00100000:1.0:1787388099.083744:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916032 00000100:00100000:0.0:1787388099.083749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388099.083761:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917056 00000100:00100000:1.0:1787388099.083765:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917056 00000100:00100000:1.0:1787388099.083791:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787388099.083799:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971916288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.083819:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916160 00000100:00100000:0.0:1787388099.083825:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916160 00000100:00100000:1.0:1787388099.083851:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971916288:12345-0@lo:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.083858:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787388099.083867:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971916160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.083908:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971916160:12345-0@lo:400:kworker.0 Request processed in 42us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.083915:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787388099.083944:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916672 00000100:00100000:0.0:1787388099.083948:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916672 00000100:00100000:0.0:1787388099.083970:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917312 00000100:00100000:0.0:1787388099.083973:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917312 00000100:00100000:0.0:1787388099.083987:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916544 00000100:00100000:0.0:1787388099.083989:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916544 00000100:00100000:1.0:1787388099.084003:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787388099.084007:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787388099.084016:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971916672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.084028:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787388099.084038:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971917184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.084054:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971916672:12345-0@lo:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.084061:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787388099.084077:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787388099.084085:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971917184:12345-0@lo:400:kworker.0 Request processed in 49us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.084086:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971917312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.084118:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971917312:12345-0@lo:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.084124:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787388099.084135:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787388099.084141:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971916544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.084167:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971916544:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.084178:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787388099.084183:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787388099.084205:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787388099.084213:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.084241:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971916800:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388099.084482:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915776 00000100:00100000:3.0:1787388099.084502:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915776 00000100:00100000:3.0:1787388099.084534:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787388099.084541:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971915776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388099.084554:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388099.084589:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971915776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388099.084595:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787388099.084744:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971917568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388099.084772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388099.084801:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971916544:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.085337:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787388099.085349:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971916032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.085399:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971916032:12345-0@lo:400:kworker.0 Request processed in 54us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.085405:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787388099.085434:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787388099.085441:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971917056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.085472:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971917056:12345-0@lo:400:kworker.0 Request processed in 32us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.085478:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787388099.086100:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:0.0:1787388099.086151:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388099.086406:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388099.086411:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388099.086414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388099.086462:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971916288:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.086476:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971916800:0@lo:400:kworker.0 00010000:00080000:0.0:1787388099.086504:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa5c380 x1874211971917312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388099.086516:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971917312:0@lo:400:kworker.0 00010000:00080000:0.0:1787388099.086529:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa4e680 x1874211971915776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388099.086544:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971915776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388099.086611:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971916032:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.086623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971917056:0@lo:400:kworker.0 00000100:00100000:3.0:1787388099.088205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917568 00000100:00100000:3.0:1787388099.088222:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917568 00000100:00100000:3.0:1787388099.088332:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787388099.088342:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971917568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388099.088379:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388099.088540:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971917568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388099.088547:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787388099.088748:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971917568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388099.088882:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388099.088932:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971916416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388099.088967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388099.089022:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971915904 00000100:00100000:0.0:1787388099.089028:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971915904 00000100:00100000:0.0:1787388099.089065:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787388099.089072:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971915904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.089112:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971915904:12345-0@lo:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.089119:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787388099.090099:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971916160:0@lo:400:kworker.0 00000100:00100000:0.0:1787388099.090114:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971916672:0@lo:400:kworker.0 00010000:00080000:0.0:1787388099.090148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa5d180 x1874211971917184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388099.090160:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971917184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.092219:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916416 00000100:00100000:1.0:1787388099.092230:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916416 00000100:00100000:2.0:1787388099.092260:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971916928:0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.092274:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787388099.092283:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971916416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388099.092321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388099.092354:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971916416:12345-0@lo:400:kworker.0 Request processed in 72us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.092361:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388099.092545:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971917440:0@lo:400:kworker.0 00000100:00100000:2.0:1787388099.092646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388099.092713:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971915904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388099.092726:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971916416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388099.092755:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971916928 00000100:00100000:2.0:1787388099.092759:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971916928 00000100:00100000:1.0:1787388099.092884:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917440 00000100:00100000:1.0:1787388099.092889:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917440 00000100:00100000:1.0:1787388099.092949:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787388099.092957:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971917440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388099.092999:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971917440:12345-0@lo:400:kworker.0 Request processed in 44us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.093005:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787388099.093482:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787388099.093502:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971916928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388099.093554:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971916928:12345-0@lo:400:kworker.0 Request processed in 65us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388099.093562:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00080000:2.0:1787388099.093883:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c5ce00 x1874211971916928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388099.093898:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971916928:0@lo:400:kworker.0 00010000:00080000:2.0:1787388099.093912:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa5df80 x1874211971917440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388099.093921:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971917440:0@lo:400:kworker.0 00000100:00080000:1.0:1787388099.095017:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388099.423716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388099.423757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388099.423779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388099.423797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388099.423822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388099.423851:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949632 00000100:00100000:3.0:1787388099.423856:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949504 00000100:00100000:1.0:1787388099.423861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949632 00000100:00100000:3.0:1787388099.423863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949504 00000100:00100000:3.0:1787388099.423922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 376 00000100:00100000:1.0:1787388099.423932:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949888 00000100:00100000:3.0:1787388099.423935:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952949504:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388099.423937:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949888 00000100:00100000:1.0:1787388099.423957:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952949760 00000100:00100000:1.0:1787388099.423961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952949760 00000100:00100000:1.0:1787388099.423975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950016 00000100:00100000:1.0:1787388099.423977:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950016 00000100:00100000:1.0:1787388099.423993:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 263 00000100:00100000:3.0:1787388099.424464:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952949504:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 531us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388099.424473:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 376 00000100:00100000:0.0:1787388099.424734:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 264 00000100:00100000:0.0:1787388099.424746:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952949888:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388099.424788:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952949888:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 45us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.424794:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 264 00000100:00100000:0.0:1787388099.424812:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 265 00000100:00100000:0.0:1787388099.424819:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952949760:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388099.424843:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952949760:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.424849:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 265 00000100:00100000:0.0:1787388099.424862:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 266 00000100:00100000:0.0:1787388099.424868:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952950016:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388099.424892:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952950016:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.424899:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 266 00000100:00080000:0.0:1787388099.424942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388099.424946:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388099.425230:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952949632:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388099.425274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952949632:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 1274us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.425281:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 263 00010000:00010000:1.0:1787388099.720340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787388100.108570:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:1.0:1787388100.108581:0:8429:0:(genops.c:906:class_export_put()) final put ffff927401ba9000/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:0.0:1787388100.108694:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff927401ba9000/74df45bd-a066-4da5-9401-b0a043132784 for lustre-OST0000 00000020:00000080:0.0:1787388100.108752:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273eee85800 for lustre-OST0000 00010000:00010000:0.0:1787388100.745650:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388101.768283:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388102.157865:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971917824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388102.157949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388102.158027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388102.158036:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971917696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388102.158064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388102.161030:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917824 00000100:00100000:3.0:1787388102.161054:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917824 00000100:00100000:3.0:1787388102.161160:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917696 00000100:00100000:3.0:1787388102.161164:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917696 00000100:00100000:2.0:1787388102.161205:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787388102.161217:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971917824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388102.161248:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388102.161352:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971917824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388102.161361:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787388102.163708:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971917824:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787388102.164764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388102.164919:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787388102.164932:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971917696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388102.164961:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388102.165053:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971917696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (6989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388102.165061:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787388102.165114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971917696:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787388102.177467:0:14065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:41:40 (1787388100) 00000100:00100000:0.0:1787388102.664309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388102.664337:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971917952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388102.664435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388102.664643:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971917952 00000100:00100000:1.0:1787388102.664653:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971917952 00000100:00100000:1.0:1787388102.664751:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787388102.664762:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971917952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388102.664797:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388102.664849:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971917952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.664856:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787388102.665012:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971917952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388102.792624:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388103.816078:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388104.201180:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971918208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388104.201252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.201320:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971918720:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.201368:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971919232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388104.201412:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971918336:0@lo:400:kworker.0 00000100:00100000:0.0:1787388104.201441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.201444:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918208 00000100:00100000:3.0:1787388104.201452:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918208 00000100:00100000:0.0:1787388104.201458:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971918848:0@lo:400:kworker.0 00000100:00100000:0.0:1787388104.201479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388104.201493:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971919360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201502:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787388104.201511:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971918208:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388104.201512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787388104.201537:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388104.201542:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919232 00000100:00100000:0.0:1787388104.201545:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919232 00000100:00100000:0.0:1787388104.201572:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918336 00000100:00100000:0.0:1787388104.201575:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918336 00000100:00100000:3.0:1787388104.201576:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971918208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.201584:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787388104.201590:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919360 00000100:00100000:0.0:1787388104.201592:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919360 00000100:00100000:3.0:1787388104.201606:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918720 00000100:00100000:0.0:1787388104.201606:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787388104.201609:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918720 00000100:00100000:0.0:1787388104.201612:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971919232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201646:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787388104.201646:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971919232:12345-0@lo:400:kworker.0 Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.201652:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971918720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388104.201652:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787388104.201664:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787388104.201676:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971918336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201709:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971918720:12345-0@lo:400:kworker.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.201715:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787388104.201730:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388104.201730:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971918336:12345-0@lo:400:kworker.0 Request processed in 55us (288us total) trans 0 rc 0/0 00000100:00080000:3.0:1787388104.201734:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388104.201736:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388104.201736:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787388104.201747:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787388104.201753:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971919360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201768:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971918720:0@lo:400:kworker.0 00000100:00100000:0.0:1787388104.201778:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971919360:12345-0@lo:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00010000:00080000:3.0:1787388104.201780:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa50e00 x1874211971919232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388104.201783:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787388104.201790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971919232:0@lo:400:kworker.0 00010000:00080000:3.0:1787388104.201800:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa6e680 x1874211971918208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388104.201801:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918848 00000100:00100000:0.0:1787388104.201804:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918848 00000100:00100000:3.0:1787388104.201813:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971918208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388104.201830:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787388104.201835:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971918848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201849:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971918464:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.201886:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971918976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.201919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971919488:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.201961:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787388104.201968:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971918080:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.201995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.202024:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971918592:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.202058:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971919104:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.202084:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971919616:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.202124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918464 00000100:00100000:3.0:1787388104.202127:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918464 00000100:00100000:3.0:1787388104.202149:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787388104.202155:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971918464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971918464:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202195:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787388104.202221:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971918464:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202246:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918976 00000100:00100000:3.0:1787388104.202249:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918976 00000100:00100000:3.0:1787388104.202267:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919616 00000100:00100000:3.0:1787388104.202269:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919616 00000100:00100000:3.0:1787388104.202282:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787388104.202287:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971918976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202320:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971918976:12345-0@lo:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202327:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787388104.202339:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787388104.202344:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971919616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202369:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971919616:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202381:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1787388104.202420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c34bfb80 x1874211971919616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388104.202429:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971919616:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202438:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971918976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202469:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919488 00000100:00100000:3.0:1787388104.202472:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919488 00000100:00100000:3.0:1787388104.202492:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918592 00000100:00100000:3.0:1787388104.202495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918592 00000100:00100000:3.0:1787388104.202505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919104 00000100:00100000:3.0:1787388104.202507:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919104 00000100:00100000:3.0:1787388104.202519:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787388104.202525:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971919488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202563:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971919488:12345-0@lo:400:kworker.0 Request processed in 38us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202569:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787388104.202579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787388104.202584:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971918592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971918592:12345-0@lo:400:kworker.0 Request processed in 23us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787388104.202621:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787388104.202627:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971919104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202650:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971919104:12345-0@lo:400:kworker.0 Request processed in 24us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1787388104.202703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388104.202707:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388104.202708:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388104.202710:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388104.202734:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971918592:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202743:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971919104:0@lo:400:kworker.0 00010000:00080000:3.0:1787388104.202751:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa50700 x1874211971919488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388104.202760:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971919488:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971918080 00000100:00100000:3.0:1787388104.202795:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971918080 00000100:00100000:3.0:1787388104.202823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787388104.202828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971918080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202862:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971918080:12345-0@lo:400:kworker.0 Request processed in 33us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.202868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787388104.202904:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971918080:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.202942:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971918336:0@lo:400:kworker.0 00000100:00100000:1.0:1787388104.203657:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971919744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388104.203743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388104.203790:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919744 00000100:00100000:1.0:1787388104.203795:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919744 00000100:00100000:1.0:1787388104.203828:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787388104.203834:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971919744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388104.203865:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388104.203904:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971919744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.203911:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1787388104.203943:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa4c380 x1874211971919744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388104.203958:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971919744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388104.204317:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971918848:12345-0@lo:400:kworker.0 Request processed in 2479us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.204325:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787388104.207318:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388104.207344:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971919872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388104.207440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388104.207556:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971919872 00000100:00100000:2.0:1787388104.207568:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971919872 00000100:00100000:3.0:1787388104.207601:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971918848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388104.207620:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971919360:0@lo:400:kworker.0 00000100:00100000:2.0:1787388104.207867:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787388104.207879:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971919872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388104.207945:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388104.208013:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971919872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.208021:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787388104.208093:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971919872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388104.257025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388104.258227:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950144 00000100:00100000:0.0:1787388104.258241:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950144 00000100:00100000:0.0:1787388104.258345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:0.0:1787388104.258356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:11115:x1874211952950144:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388104.258377:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388104.258413:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c81 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.258494:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.258525:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.258539:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388104.258589:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787388104.258593:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388104.258631:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.258674:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c81 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.258743:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c81 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.258753:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c303d500) 00010000:00010000:0.0:1787388104.258756:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388104.258760:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:0.0:1787388104.258823:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+6:11115:x1874211952950144:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 469us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.258832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00080000:3.0:1787388104.262651:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388104.270076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388104.270210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950272 00000100:00100000:3.0:1787388104.270222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950272 00000100:00100000:3.0:1787388104.270416:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:3.0:1787388104.270428:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+6:11116:x1874211952950272:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388104.270461:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388104.270484:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811da1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c88 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270552:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270566:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270576:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270590:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270597:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270603:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270666:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b1811db6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270674:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b1811db6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270744:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b1811db6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388104.270786:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388104.270790:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388104.270810:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b1811db6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270821:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270827:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270833:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270838:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388104.270857:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270864:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c303d500) 00010000:00010000:3.0:1787388104.270880:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388104.270884:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270891:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270914:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270919:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270925:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270930:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388104.270933:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270939:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270947:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9273fbd42400) 00010000:00010000:3.0:1787388104.270949:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388104.270952:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270957:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811daf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.270989:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c88 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.271001:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b1811db6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c88 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.271019:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9273fbd42700) 00010000:00010000:3.0:1787388104.271021:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388104.271024:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496800, rc 0) 00000100:00100000:3.0:1787388104.271089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+7:11116:x1874211952950272:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 662us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.271096:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:1.0:1787388104.280356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388104.280589:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950400 00000100:00100000:3.0:1787388104.280601:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950400 00000100:00100000:3.0:1787388104.280705:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:3.0:1787388104.280718:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74df45bd-a066-4da5-9401-b0a043132784+7:11116:x1874211952950400:12345-192.168.204.52@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787388104.280805:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74df45bd-a066-4da5-9401-b0a043132784+7:11116:x1874211952950400:12345-192.168.204.52@tcp:900:lhsmtool_posix.0 Request processed in 89us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.280814:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:0.0:1787388104.296843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388104.299113:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950656 00000100:00100000:1.0:1787388104.299128:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950656 00000100:00100000:1.0:1787388104.299215:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:1.0:1787388104.299225:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+7:11116:x1874211952950656:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388104.299246:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388104.299273:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1811dbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c8f expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299352:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299366:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299379:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299407:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299415:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299422:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299542:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4400/0x5cb77467b1811dd2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299551:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4400/0x5cb77467b1811dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299571:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4400/0x5cb77467b1811dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388104.299583:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787388104.299736:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299744:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299750:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299756:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388104.299760:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299767:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299779:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9273fbd42700) 00010000:00010000:1.0:1787388104.299782:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388104.299786:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299793:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811dc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299807:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299812:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299825:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299830:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388104.299833:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299852:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299861:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9273d13bdb00) 00010000:00010000:1.0:1787388104.299864:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388104.299867:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.299873:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1811dcb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.300136:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1811dbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c8f expref: 10 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.300152:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4400/0x5cb77467b1811dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c8f expref: 9 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.300159:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:1.0:1787388104.300162:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388104.300164:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4400, rc 0) 00000100:00100000:1.0:1787388104.301212:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+9:11116:x1874211952950656:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 1981us (4373us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787388104.301237:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:1.0:1787388104.322984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388104.323210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950784 00000100:00100000:0.0:1787388104.323220:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950784 00000100:00100000:0.0:1787388104.323281:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:0.0:1787388104.323291:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+9:11116:x1874211952950784:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787388104.323432:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+9:11116:x1874211952950784:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 Request processed in 142us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.323440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:0.0:1787388104.328152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388104.329568:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952950912 00000100:00100000:3.0:1787388104.329585:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952950912 00000100:00100000:3.0:1787388104.329675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:3.0:1787388104.329727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:11116:x1874211952950912:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787388104.330156:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787388104.333496:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3726us 00000100:00100000:3.0:1787388104.348864:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:11116:x1874211952950912:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 Request processed in 19107us (20690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.348880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 44 00000040:00080000:1.0:1787388104.393556:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787388104.394384:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787388104.538479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388104.538538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388104.538571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388104.538609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951040 00000100:00100000:0.0:1787388104.538620:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951040 00000100:00100000:0.0:1787388104.538674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 378 00000100:00100000:0.0:1787388104.538711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952951040:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388104.538789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211952951040:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.538798:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 378 00000100:00100000:0.0:1787388104.538836:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951168 00000100:00100000:2.0:1787388104.539542:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951296 00000100:00100000:2.0:1787388104.539550:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951296 00000100:00100000:0.0:1787388104.539612:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951168 00000100:00080000:1.0:1787388104.539866:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388104.539871:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388104.543733:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 273 00000100:00100000:0.0:1787388104.543755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952951296:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388104.543856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952951296:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 109us (5284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.543864:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 273 00000100:00100000:0.0:1787388104.543886:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 274 00000100:00100000:0.0:1787388104.543894:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952951168:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388104.543935:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952951168:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 42us (5468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.543942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 274 00010000:00010000:2.0:1787388104.855544:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388105.868080:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388106.642373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.642791:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951424 00000100:00100000:3.0:1787388106.642801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951424 00000100:00100000:3.0:1787388106.642893:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:3.0:1787388106.642903:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+9:11158:x1874211952951424:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388106.642936:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388106.642958:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c96 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643027:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643044:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643058:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643073:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643080:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643087:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643131:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643139:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643146:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643151:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388106.643161:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643169:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643183:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c303d500) 00010000:00010000:3.0:1787388106.643186:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388106.643190:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643197:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643209:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643215:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643220:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643225:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388106.643228:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643234:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643242:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9273da1a0c00) 00010000:00010000:3.0:1787388106.643244:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388106.643253:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643260:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811dee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643293:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811de0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c96 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643304:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c303d500) 00010000:00010000:3.0:1787388106.643307:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388106.643310:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c96 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.643319:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497800, rc 0) 00000100:00100000:3.0:1787388106.643389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+9:11158:x1874211952951424:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 487us (1025us total) trans 0 rc 301/301 00000100:00100000:3.0:1787388106.643397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00080000:1.0:1787388106.643562:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388106.651590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.651664:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951680 00000100:00100000:2.0:1787388106.651673:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951680 00000100:00100000:2.0:1787388106.651998:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:2.0:1787388106.652009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+9:11158:x1874211952951680:12345-192.168.204.52@tcp:36:lfs.0 00010000:00010000:2.0:1787388106.652064:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388106.652090:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c81 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.652106:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c303d500) 00010000:00010000:2.0:1787388106.652116:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388106.652179:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.652192:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.652202:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.652216:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.652238:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.652245:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653272:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653286:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653294:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388106.653311:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087d12776 reply state 00000000e4495352 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653323:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653329:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388106.653332:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388106.653335:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388106.653351:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787388106.653359:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653366:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653372:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653387:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388106.653392:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653400:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653410:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d8f07300) 00010000:00010000:2.0:1787388106.653413:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388106.653416:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653422:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811df5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388106.653437:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087d12776 reply state 00000000e4495352 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653445:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.653451:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9273d8f07000) 00010000:00010000:2.0:1787388106.653453:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388106.653455:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787388106.656921:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+10:11158:x1874211952951680:12345-192.168.204.52@tcp:36:lfs.0 Request processed in 4903us (5329us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787388106.656933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:1.0:1787388106.745006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.745210:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951808 00000100:00100000:3.0:1787388106.745220:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951808 00000100:00100000:3.0:1787388106.745279:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:3.0:1787388106.745288:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+10:11166:x1874211952951808:12345-192.168.204.52@tcp:101:lctl.0 00010000:00010000:3.0:1787388106.745310:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388106.745333:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4c9d expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.745411:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811e11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.745464:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.745475:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388106.745534:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388106.745538:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388106.745575:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.745599:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c9d expref: 12 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.745615:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c9d expref: 11 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.745623:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:3.0:1787388106.745627:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388106.745631:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497e00, rc 0) 00000100:00100000:3.0:1787388106.745728:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+11:11166:x1874211952951808:12345-192.168.204.52@tcp:101:lctl.0 Request processed in 439us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388106.745737:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:1.0:1787388106.805209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.805317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952951936 00000100:00100000:2.0:1787388106.805328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952951936 00000100:00100000:2.0:1787388106.805482:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 48 00000100:00100000:2.0:1787388106.805508:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+11:11172:x1874211952951936:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:2.0:1787388106.805540:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388106.805562:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ca4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805630:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805643:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805654:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805665:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805672:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805717:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805812:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811e2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805821:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.805828:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388106.805884:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787388106.805887:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388106.805923:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806103:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806110:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806116:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806122:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fec00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388106.806126:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806134:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806148:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388106.806151:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388106.806156:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806162:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806179:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806197:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806203:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806208:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffe00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388106.806212:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806218:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9273d8f07000) 00010000:00010000:2.0:1787388106.806230:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388106.806233:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806239:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811e26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ca4 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806285:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ca4 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.806292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388106.806435:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787388106.806447:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe000, rc 0) 00000100:00100000:3.0:1787388106.806836:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+12:11172:x1874211952951936:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1328us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388106.806846:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 48 00000100:00100000:0.0:1787388106.810489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.810630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952952192 00000100:00100000:2.0:1787388106.810640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952952192 00000100:00100000:2.0:1787388106.810747:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:2.0:1787388106.810758:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+12:11172:x1874211952952192:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:2.0:1787388106.810777:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388106.810797:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e34 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.810900:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.810914:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.810924:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.810984:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.810993:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811002:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388106.811360:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787388106.811602:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811612:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811628:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811665:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811672:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811701:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811707:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388106.811712:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811719:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811731:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388106.811734:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388106.811739:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811746:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1811e3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388106.811761:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a4a4d0f reply state 000000004fb8b528 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811771:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811784:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:2.0:1787388106.811786:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388106.811789:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787388106.811818:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811833:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.811841:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:2.0:1787388106.811843:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388106.811845:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe600, rc 0) 00000100:00100000:2.0:1787388106.811917:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+15:11172:x1874211952952192:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1158us (1447us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787388106.811924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:1.0:1787388106.816417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.816500:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952952320 00000100:00100000:3.0:1787388106.816509:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952952320 00000100:00100000:3.0:1787388106.816578:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:3.0:1787388106.816586:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874211952952320:12345-192.168.204.52@tcp:8:bash.0 00010000:00080000:3.0:1787388106.816622:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:3.0:1787388106.816650:0:8437:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b1811e57 00002000:00100000:3.0:1787388106.816662:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 74df45bd-a066-4da5-9401-b0a043132784/ffff9273ffb3b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787388106.816712:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 76, return 76 00002000:00080000:3.0:1787388106.816790:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787388106.816835:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9273ffb3c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388106.816912:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952952320:12345-192.168.204.52@tcp:8:bash.0 Request processed in 325us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388106.816919:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:1.0:1787388106.819321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.819450:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952952448 00000100:00100000:2.0:1787388106.819460:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952952448 00000100:00100000:2.0:1787388106.819533:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:2.0:1787388106.819546:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952952448:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:2.0:1787388106.819563:0:10361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388106.819586:0:10361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cb2 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388106.819613:0:10361:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388106.819631:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787388106.819635:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388106.819657:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 7 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.819710:0:10361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 7 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.819724:0:10361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff400, rc 0) 00000100:00100000:2.0:1787388106.819777:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:0:x1874211952952448:12345-192.168.204.52@tcp:101:bash.0 Request processed in 234us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388106.819784:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00080000:1.0:1787388106.821384:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388106.822800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.822970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952952576 00000100:00100000:3.0:1787388106.822980:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952952576 00000100:00100000:3.0:1787388106.823031:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:3.0:1787388106.823040:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:11172:x1874211952952576:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388106.823056:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388106.823073:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cb9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.823102:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 8 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.823110:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388106.823114:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388106.823119:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.823170:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 8 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.823182:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 8 pid: 10361 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388106.823196:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874211971920000:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388106.823289:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787388106.827328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388106.827331:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874211971920000:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388106.827374:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388106.827396:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497800, rc 0) 00000100:00100000:2.0:1787388106.827431:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952952704 00000100:00100000:2.0:1787388106.827438:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952952704 00000100:00100000:0.0:1787388106.827467:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+9:11172:x1874211952952576:12345-192.168.204.52@tcp:101:bash.0 Request processed in 4427us (4674us total) trans 0 rc 0/0 00010000:00010000:2.0:1787388106.827472:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 9 pid: 10361 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388106.827476:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:2.0:1787388106.827508:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:2.0:1787388106.827517:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211952952704:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388106.827531:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388106.827555:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 8 pid: 10361 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.827567:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 8 pid: 10361 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.827592:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811e5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb2 expref: 8 pid: 10361 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.827628:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388106.827631:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388106.827640:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.827650:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.827733:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388106.827748:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1874211971920128:192.168.204.52@tcp:105: 00000100:00100000:2.0:1787388106.827816:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388106.830882:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1874211971920128:192.168.204.52@tcp:105: 00010000:00010000:2.0:1787388106.830913:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388106.830975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952952704:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 3458us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388106.830986:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:1.0:1787388106.841239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.841422:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952952960 00000100:00100000:2.0:1787388106.841432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952952960 00000100:00100000:2.0:1787388106.841491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:2.0:1787388106.841501:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+15:11172:x1874211952952960:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:2.0:1787388106.842118:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+16:11172:x1874211952952960:12345-192.168.204.52@tcp:35:bash.0 Request processed in 616us (887us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787388106.842142:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 6 00010000:00010000:0.0:1787388106.888350:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388106.909350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.909445:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952953216 00000100:00100000:3.0:1787388106.909456:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952953216 00000100:00100000:3.0:1787388106.909621:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:3.0:1787388106.909632:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+16:11182:x1874211952953216:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388106.909656:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388106.909676:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cc0 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388106.909817:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787388106.909934:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811e6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cc0 expref: 18 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.909948:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:3.0:1787388106.909952:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388106.909957:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cc0 expref: 18 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.909989:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497600, rc 0) 00000100:00100000:3.0:1787388106.910051:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+17:11182:x1874211952953216:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 421us (720us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787388106.910057:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:3.0:1787388106.913149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388106.913322:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952953472 00000100:00100000:0.0:1787388106.913333:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952953472 00000100:00100000:0.0:1787388106.913407:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:0.0:1787388106.913419:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+17:11182:x1874211952953472:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388106.913672:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+18:11182:x1874211952953472:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 253us (531us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787388106.913713:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:1.0:1787388106.978411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.978659:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952953600 00000100:00100000:3.0:1787388106.978669:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952953600 00000100:00100000:3.0:1787388106.978747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:3.0:1787388106.978758:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+18:11188:x1874211952953600:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388106.978781:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388106.978801:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cc7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.979068:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1811e81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.979081:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1811e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.979092:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1811e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388106.979133:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787388106.979137:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388106.979156:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1811e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.979182:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cc7 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.979210:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1811e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cc7 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.979219:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:3.0:1787388106.979224:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388106.979226:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496e00, rc 0) 00000100:00100000:3.0:1787388106.979323:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+19:11188:x1874211952953600:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 567us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388106.979331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:1.0:1787388106.982361:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.982496:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952953856 00000100:00100000:2.0:1787388106.982505:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952953856 00000100:00100000:2.0:1787388106.982569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:2.0:1787388106.982578:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:11188:x1874211952953856:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388106.982599:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388106.982623:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.982770:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.982784:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.982795:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388106.982806:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787388106.982913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cce expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.983251:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cce expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.983258:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:2.0:1787388106.983260:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388106.983262:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00100000:2.0:1787388106.983409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+21:11188:x1874211952953856:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 831us (1072us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787388106.983417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:1.0:1787388106.987588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388106.987700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388106.987781:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952954240 00000100:00100000:3.0:1787388106.987797:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952954240 00000100:00100000:3.0:1787388106.987857:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:3.0:1787388106.987867:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+21:11188:x1874211952954240:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388106.987890:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388106.987912:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811e9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cd5 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.988066:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811ea4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.988079:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.988090:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388106.988103:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787388106.988214:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811e9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cd5 expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.988233:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cd5 expref: 23 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388106.988242:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:3.0:1787388106.988245:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787388106.988249:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496000, rc 0) 00000100:00100000:3.0:1787388106.988316:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+23:11188:x1874211952954240:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 450us (638us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787388106.988324:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:0.0:1787388106.989331:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952953984 00000100:00100000:0.0:1787388106.989352:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952953984 00000100:00100000:0.0:1787388106.989448:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:0.0:1787388106.989468:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+23:2402:x1874211952953984:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388106.989481:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388106.989501:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811e8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cce expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388106.989516:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:0.0:1787388106.989521:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388106.989576:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+22:2402:x1874211952953984:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 109us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388106.989583:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:1.0:1787388106.995620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388106.996155:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952954368 00000100:00100000:2.0:1787388106.996167:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952954368 00000100:00100000:2.0:1787388106.996223:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:2.0:1787388106.996233:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952954368:12345-192.168.204.52@tcp:1:lfs.0 00010000:00010000:2.0:1787388106.996283:0:10361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.996353:0:10361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.996363:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388106.996367:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388106.996373:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.996416:0:10361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388106.996430:0:10361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 7 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388106.996444:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10361:1874211971920256:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388106.996578:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388106.999264:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10361:1874211971920256:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388106.999303:0:10361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388107.000320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388107.002052:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952954496 00000100:00100000:3.0:1787388107.002066:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952954496 00002000:00100000:3.0:1787388107.002115:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9273ffaefb80 x1874211952954496/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:363/0 lens 504/0 e 0 to 0 dl 1787388118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388107.002126:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273ffaefb80 with x1874211952954496 ext(0->12) 00010000:00010000:3.0:1787388107.002135:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 8 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.002153:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 8 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388107.002161:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9273ffaefb80 00000100:00100000:3.0:1787388107.002249:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:3.0:1787388107.002259:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211952954496:12345-192.168.204.52@tcp:4:lfs.0 00000001:00100000:1.0:1787388107.006584:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000100:00100000:3.0:1787388107.007640:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+9:2404:x1874211952954496:12345-192.168.204.52@tcp:4:lfs.0 Request processed in 5373us (7316us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787388107.007667:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00002000:00100000:3.0:1787388107.007700:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9273ffaefb80 x1874211952954496/t4294967300(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:363/0 lens 504/448 e 0 to 0 dl 1787388118 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388107.007711:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273ffaefb80 with x1874211952954496 ext(0->12) 00010000:00010000:3.0:1787388107.007722:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.007740:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388107.007748:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9273ffaefb80 00000100:00100000:0.0:1787388107.015222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388107.015373:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952954624 00000100:00100000:3.0:1787388107.015385:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952954624 00010000:00010000:3.0:1787388107.015425:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388107.015470:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:3.0:1787388107.015480:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+9:2401:x1874211952954624:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388107.015495:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787388107.015514:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787388107.015517:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787388106 00002000:00010000:3.0:1787388107.015519:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787388107 00002000:00010000:3.0:1787388107.015521:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787388106 00002000:00010000:3.0:1787388107.015524:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787388107.015531:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.015561:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.015586:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1811e65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cb9 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.015604:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388107.015608:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388107.015614:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.015921:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.015960:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388107.016017:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211952954624:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 538us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388107.016025:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 53 00010000:00010000:2.0:1787388107.016316:0:10361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016329:0:10361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016359:0:10361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016368:0:10361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016376:0:10361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016384:0:10361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388107.016388:0:10361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016398:0:10361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016424:0:10361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.016432:0:10361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039d737d1/0x5cb77467b1811eb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388107.016544:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952954368:12345-192.168.204.52@tcp:1:lfs.0 Request processed in 20311us (20933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388107.016552:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:0.0:1787388107.025621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388107.026029:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952954880 00000100:00100000:3.0:1787388107.026039:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952954880 00000100:00100000:3.0:1787388107.026390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:3.0:1787388107.026401:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+22:11188:x1874211952954880:12345-192.168.204.52@tcp:35:lfs.0 00000004:00010000:3.0:1787388107.027639:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cd5 expref: 22 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388107.029576:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1787388107.029645:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787388107.030529:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1787388107.030575:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.031156:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.031166:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.031207:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.031223:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 26 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388107.031238:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa52680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211971920384:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388107.031399:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388107.033760:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa52680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211971920384:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388107.033790:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388107.034674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.034764:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952955008 00000100:00100000:2.0:1787388107.034773:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952955008 00010000:00010000:2.0:1787388107.034811:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 27 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388107.034852:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:2.0:1787388107.034871:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+27:2404:x1874211952955008:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388107.034888:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388107.034894:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 27 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.034905:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 27 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.034937:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811e49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cab expref: 27 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.034972:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:2.0:1787388107.034976:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.034985:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.034992:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.035018:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388107.035037:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.035047:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388107.035080:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+26:2404:x1874211952955008:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 209us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388107.035088:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 54 00000001:00080000:3.0:1787388107.035161:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1787388107.035276:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787388107.035373:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa52680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211971920512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787388107.035423:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388107.035454:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388107.035507:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971920512 00000100:00100000:0.0:1787388107.035512:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971920512 00000100:00080000:1.0:1787388107.035558:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388107.035572:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787388107.035589:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211971920512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388107.035674:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211971920512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388107.035700:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787388107.035744:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa52680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211971920512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787388107.035902:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1787388107.035947:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211971920640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787388107.035975:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388107.036012:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2db6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388107.036061:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971920640 00000100:00100000:0.0:1787388107.036066:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971920640 00000100:00100000:0.0:1787388107.036097:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787388107.036104:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211971920640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388107.036208:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874211971920640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (231us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787388107.036225:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787388107.036258:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211971920640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787388107.036296:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787388107.036332:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.036351:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.036357:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.036362:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388107.036366:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.036373:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.036385:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:0.0:1787388107.036388:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787388107.036392:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.036397:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b1811eb9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388107.036484:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787388107.037625:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787388107.037640:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396021960663ns, next at 397021957516ns, rc = 0 00000001:00080000:0.0:1787388107.037659:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787388107.037720:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d8f07100) 00010000:00010000:0.0:1787388107.037723:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787388107.037732:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1811ea4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cd5 expref: 30 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388107.038117:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+29:11188:x1874211952954880:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 11716us (12503us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787388107.038129:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 8 00000020:00080000:2.0:1787388107.038134:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787388107.043081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388107.043178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952955136 00000100:00100000:3.0:1787388107.043189:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952955136 00000100:00100000:3.0:1787388107.043253:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:3.0:1787388107.043264:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+29:11188:x1874211952955136:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388107.043287:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388107.043311:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811ec0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cdc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.043385:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cdc expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.043402:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cdc expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.043421:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:3.0:1787388107.043433:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388107.043437:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:3.0:1787388107.043498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+30:11188:x1874211952955136:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 235us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388107.043506:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:1.0:1787388107.050024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.050181:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952955392 00000100:00100000:2.0:1787388107.050191:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952955392 00000100:00100000:2.0:1787388107.050253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:2.0:1787388107.050265:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+30:11188:x1874211952955392:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:2.0:1787388107.050519:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+31:11188:x1874211952955392:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 256us (514us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787388107.050589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:1.0:1787388107.128904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.131122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952955648 00000100:00100000:2.0:1787388107.131137:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952955648 00000100:00100000:2.0:1787388107.131612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:2.0:1787388107.131635:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+31:11197:x1874211952955648:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388107.131662:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388107.131721:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ce3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388107.131842:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787388107.131954:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811ec7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ce3 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.131981:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388107.131984:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388107.131990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ce3 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.132014:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe600, rc 0) 00000100:00100000:2.0:1787388107.132086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+32:11197:x1874211952955648:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 463us (3190us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787388107.132094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:0.0:1787388107.134737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388107.135319:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952955776 00000100:00100000:1.0:1787388107.135330:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952955776 00000100:00100000:1.0:1787388107.135404:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:1.0:1787388107.135414:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+32:11197:x1874211952955776:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:1.0:1787388107.135496:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135513:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135535:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135543:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135549:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135770:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135780:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.135788:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388107.135862:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136081:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136088:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136095:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136101:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388107.136105:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136112:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136125:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388107.136128:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388107.136132:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136138:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1811ed5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136153:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136159:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136171:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136177:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388107.136180:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136186:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136194:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:1.0:1787388107.136197:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388107.136200:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136206:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136217:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136223:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136228:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136233:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388107.136236:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136251:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136259:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388107.136262:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388107.136265:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.136270:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388107.136357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+32:11197:x1874211952955776:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 942us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388107.136365:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:1.0:1787388107.139326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.139424:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952956032 00000100:00100000:2.0:1787388107.139433:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952956032 00000100:00100000:2.0:1787388107.139523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:2.0:1787388107.139535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+32:11197:x1874211952956032:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:2.0:1787388107.139771:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+33:11197:x1874211952956032:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 239us (454us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787388107.139780:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:0.0:1787388107.174728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388107.175221:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952956288 00000100:00100000:3.0:1787388107.175246:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952956288 00000100:00100000:3.0:1787388107.175382:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:3.0:1787388107.175393:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+33:11201:x1874211952956288:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388107.175418:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388107.175451:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811eea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175526:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175541:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175552:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175563:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175570:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175577:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175728:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175737:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.175757:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388107.175775:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787388107.176052:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176060:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176066:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176072:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388107.176076:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176084:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176096:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:3.0:1787388107.176100:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388107.176103:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176109:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1811ef1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176122:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176128:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176144:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176149:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388107.176152:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176159:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176167:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:3.0:1787388107.176169:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388107.176172:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176178:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b1811ef8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176216:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811eea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176229:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.176237:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:3.0:1787388107.176239:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388107.176241:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496400, rc 0) 00000100:00100000:3.0:1787388107.176308:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+35:11201:x1874211952956288:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 917us (1589us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787388107.176325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:0.0:1787388107.179350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.179524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952956416 00000100:00100000:2.0:1787388107.179543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952956416 00000100:00100000:2.0:1787388107.179637:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:2.0:1787388107.179648:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+35:11201:x1874211952956416:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:2.0:1787388107.179746:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179764:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179775:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179812:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179819:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179826:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179831:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388107.179846:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179853:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179865:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388107.179868:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388107.179873:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.179888:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388107.179963:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+35:11201:x1874211952956416:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 316us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388107.179971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:2.0:1787388107.183667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388107.184194:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952956672 00000100:00100000:1.0:1787388107.184204:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952956672 00000100:00100000:1.0:1787388107.184286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:1.0:1787388107.184296:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+35:11201:x1874211952956672:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388107.184617:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+36:11201:x1874211952956672:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 320us (957us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787388107.184625:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:3.0:1787388107.272346:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388107.272371:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971920768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388107.272448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388107.272827:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971920768 00000100:00100000:1.0:1787388107.272835:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971920768 00000100:00100000:0.0:1787388107.272847:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971920896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388107.272880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787388107.273945:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388107.275024:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971920896 00000100:00100000:3.0:1787388107.275036:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971920896 00000100:00100000:3.0:1787388107.275171:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787388107.275181:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971920768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388107.275213:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388107.275286:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971920768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388107.275294:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787388107.275311:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787388107.275318:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971920896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388107.275327:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388107.275362:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971920896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388107.275368:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787388107.275432:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971920896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388107.275448:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971920768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787388107.276794:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388107.424008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388107.424217:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952956928 00000100:00100000:1.0:1787388107.424227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952956928 00000100:00100000:1.0:1787388107.424341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:1.0:1787388107.424352:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+36:11232:x1874211952956928:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:1.0:1787388107.424391:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388107.424412:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cf1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.424540:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811f1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.424558:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.424570:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388107.424582:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787388107.424728:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf1 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.424748:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811f1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf1 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.424757:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388107.424760:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388107.424764:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4800, rc 0) 00000100:00100000:1.0:1787388107.424852:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+38:11232:x1874211952956928:12345-192.168.204.52@tcp:101:cat.0 Request processed in 502us (852us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787388107.424860:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:0.0:1787388107.430299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.430641:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952957056 00000100:00100000:2.0:1787388107.430651:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952957056 00000100:00100000:2.0:1787388107.430768:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:2.0:1787388107.430780:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+38:2401:x1874211952957056:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388107.430812:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388107.430915:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1811f1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf1 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.431010:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388107.431015:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388107.431074:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+37:2401:x1874211952957056:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 296us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388107.431083:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:0.0:1787388107.431247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.431488:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952957312 00000100:00100000:2.0:1787388107.431494:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952957312 00000100:00100000:2.0:1787388107.431539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:2.0:1787388107.431547:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+37:11232:x1874211952957312:12345-192.168.204.52@tcp:35:cat.0 00000100:00100000:2.0:1787388107.431886:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+38:11232:x1874211952957312:12345-192.168.204.52@tcp:35:cat.0 Request processed in 339us (638us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1787388107.431912:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:2.0:1787388107.515181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388107.515285:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952957568 00000100:00100000:3.0:1787388107.515295:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952957568 00000100:00100000:3.0:1787388107.515367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:3.0:1787388107.515377:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+38:11238:x1874211952957568:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:3.0:1787388107.515417:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388107.515419:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787388107.515445:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1811e81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cc7 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388107.515464:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:3.0:1787388107.515469:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388107.515481:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811f29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cf8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.518480:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.518508:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.518516:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.518569:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.518585:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 38 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388107.518599:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211971921024:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388107.518725:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388107.523466:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.524195:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211971921024:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388107.524226:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388107.524452:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952957696 00000100:00100000:1.0:1787388107.524460:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952957696 00010000:00010000:1.0:1787388107.524499:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 39 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388107.524544:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:1.0:1787388107.524554:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+39:2404:x1874211952957696:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388107.524569:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388107.524576:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 39 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.524589:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 39 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.524612:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b1811eff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cea expref: 39 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.524627:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388107.524632:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.524641:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.524647:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.524690:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388107.524715:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.524723:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388107.524743:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787388107.524750:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+38:2404:x1874211952957696:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 197us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388107.524757:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00010000:00010000:0.0:1787388107.524910:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1811f29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.525030:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.525051:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388107.525053:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787388107.525056:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffe00, rc 0) 00000100:00100000:0.0:1787388107.525080:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+38:11238:x1874211952957568:12345-192.168.204.52@tcp:101:dd.0 Request processed in 9705us (9911us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787388107.525087:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:0.0:1787388107.530498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.530657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952957824 00000100:00100000:2.0:1787388107.530667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952957824 00000100:00100000:2.0:1787388107.530756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:2.0:1787388107.530768:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+38:11238:x1874211952957824:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:2.0:1787388107.531083:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388107.531107:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811f3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4cff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.531219:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.531235:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.531247:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.531380:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811f3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.531400:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.531409:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388107.531412:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388107.531416:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff400, rc 0) 00000100:00100000:2.0:1787388107.531607:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+39:11238:x1874211952957824:12345-192.168.204.52@tcp:101:dd.0 Request processed in 840us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388107.531615:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:2.0:1787388107.536625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388107.536886:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952958080 00000100:00100000:1.0:1787388107.536908:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952958080 00000100:00100000:1.0:1787388107.537100:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:1.0:1787388107.537111:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+39:11238:x1874211952958080:12345-192.168.204.52@tcp:36:dd.0 00010000:00010000:1.0:1787388107.537338:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.537365:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.537378:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388107.537427:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1787388107.537448:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fd14de6 reply state 0000000098f4967e transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.537460:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.537468:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388107.537471:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388107.537475:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388107.537568:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+42:11238:x1874211952958080:12345-192.168.204.52@tcp:36:dd.0 Request processed in 459us (953us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787388107.537576:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 62 00000020:00080000:1.0:1787388107.537582:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388107.758527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388107.758715:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952958208 00000100:00100000:0.0:1787388107.758726:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952958208 00000100:00100000:0.0:1787388107.758786:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:0.0:1787388107.758806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+42:11253:x1874211952958208:12345-192.168.204.52@tcp:101:stat.0 00010000:00010000:0.0:1787388107.758831:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388107.758851:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d06 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.758935:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.758949:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.758960:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.758971:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.758978:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.758999:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.759074:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.759085:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.759094:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.759142:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.759155:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 43 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388107.759168:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211971921152:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388107.759275:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388107.767806:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211971921152:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388107.767841:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388107.768725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388107.769981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952958464 00000100:00100000:2.0:1787388107.769995:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952958464 00000100:00100000:2.0:1787388107.770065:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:2.0:1787388107.770076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+44:6172:x1874211952958464:12345-192.168.204.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787388107.770421:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+45:6172:x1874211952958464:12345-192.168.204.52@tcp:35:ldlm_bl.0 Request processed in 346us (1700us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787388107.770429:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:2.0:1787388107.774851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388107.774945:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952958592 00000100:00100000:1.0:1787388107.774955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952958592 00010000:00010000:1.0:1787388107.774997:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 45 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388107.775056:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:1.0:1787388107.775066:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+45:2404:x1874211952958592:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388107.775081:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388107.775089:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 45 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.775102:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 45 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.775123:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811f30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cf8 expref: 45 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.775140:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388107.775146:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.775156:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.775173:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388107.775203:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388107.775259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+44:2404:x1874211952958592:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 193us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388107.775266:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 56 00010000:00010000:2.0:1787388107.779477:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779498:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388107.779564:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787388107.779569:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388107.779618:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779632:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779644:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779650:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779657:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779715:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388107.779720:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779728:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779743:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388107.779746:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388107.779751:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779756:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811f5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779775:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779781:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779958:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779965:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388107.779968:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779975:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.779993:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:2.0:1787388107.779995:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388107.779998:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.780004:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1811f61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.780045:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d06 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.780059:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d06 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388107.780065:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388107.780068:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388107.780070:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb200, rc 0) 00000100:00100000:2.0:1787388107.781012:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+43:11253:x1874211952958208:12345-192.168.204.52@tcp:101:stat.0 Request processed in 22203us (22489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388107.781023:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:2.0:1787388107.785590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971921280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388107.785771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388107.786060:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971921280 00000100:00100000:0.0:1787388107.786068:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971921280 00000100:00100000:0.0:1787388107.786120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787388107.786129:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971921280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388107.786176:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388107.786236:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971921280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388107.786251:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787388107.786296:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971921280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388107.890297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388107.890394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952958848 00000100:00100000:0.0:1787388107.890406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952958848 00000100:00100000:0.0:1787388107.890467:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:0.0:1787388107.890479:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+43:11259:x1874211952958848:12345-192.168.204.52@tcp:36:truncate.0 00010000:00010000:0.0:1787388107.890537:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388107.890563:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d06 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.890583:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388107.890587:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388107.890815:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.890828:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.890838:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388107.890874:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1787388107.890894:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f67733bc reply state 00000000aa3f8d4b transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.890917:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388107.890924:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388107.890936:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388107.890938:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388107.891051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+45:11259:x1874211952958848:12345-192.168.204.52@tcp:36:truncate.0 Request processed in 574us (764us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787388107.891059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 64 00000020:00080000:0.0:1787388107.891064:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787388107.912992:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388108.053827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.053968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952958976 00000100:00100000:0.0:1787388108.053979:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952958976 00000100:00100000:0.0:1787388108.054059:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 65 00000100:00100000:0.0:1787388108.054070:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+45:11273:x1874211952958976:12345-192.168.204.52@tcp:101:stat.0 00010000:00010000:0.0:1787388108.054094:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388108.054114:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d0d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054210:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054225:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054238:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054250:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054256:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054262:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054350:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054358:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054365:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388108.054411:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787388108.054415:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388108.054437:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054447:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054456:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054461:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054467:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054472:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388108.054476:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054483:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054502:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388108.054505:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388108.054509:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054515:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1811f7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054527:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054533:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054538:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054542:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388108.054550:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054556:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054562:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:0.0:1787388108.054565:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388108.054568:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054572:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811f84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054612:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054626:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.054633:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388108.054636:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388108.054638:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa600, rc 0) 00000100:00100000:0.0:1787388108.054782:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+46:11273:x1874211952958976:12345-192.168.204.52@tcp:101:stat.0 Request processed in 713us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388108.054791:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 65 00000100:00080000:1.0:1787388108.055186:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388108.188363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.191373:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952959232 00000100:00100000:0.0:1787388108.191390:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952959232 00000100:00100000:0.0:1787388108.191473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00100000:0.0:1787388108.191484:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+46:11283:x1874211952959232:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388108.191506:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388108.191528:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d14 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388108.191638:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787388108.191767:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d14 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.191969:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:0.0:1787388108.191973:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388108.191993:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d14 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.192010:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb200, rc 0) 00000100:00100000:0.0:1787388108.192081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+47:11283:x1874211952959232:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 598us (3729us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1787388108.192087:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00100000:2.0:1787388108.197480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.197573:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952959488 00000100:00100000:0.0:1787388108.197583:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952959488 00000100:00100000:0.0:1787388108.197650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:0.0:1787388108.197662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+47:11283:x1874211952959488:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388108.198096:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+48:11283:x1874211952959488:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 434us (622us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787388108.198104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:1.0:1787388108.265591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.265729:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952959744 00000100:00100000:0.0:1787388108.265740:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952959744 00000100:00100000:0.0:1787388108.265820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:0.0:1787388108.265830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+48:11289:x1874211952959744:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388108.265853:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388108.266008:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fa0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d1b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.266126:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.266144:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.266173:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.266207:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.266221:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 49 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388108.266236:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971921408:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388108.266351:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388108.276626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388108.276981:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952959872 00000100:00100000:1.0:1787388108.276992:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952959872 00010000:00010000:1.0:1787388108.277033:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 50 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388108.277076:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:1.0:1787388108.277086:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+50:2403:x1874211952959872:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388108.277102:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388108.277108:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 50 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.277121:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 50 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.277145:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388108.277150:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.277161:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.277169:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.277189:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388108.277351:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1811f8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d0d expref: 50 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388108.277367:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971921408:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388108.277388:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.277397:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.277403:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388108.277420:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787388108.277556:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fa0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.277586:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.277593:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388108.277596:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787388108.277599:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb400, rc 0) 00000100:00100000:1.0:1787388108.277639:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+50:2403:x1874211952959872:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 554us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388108.277655:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:0.0:1787388108.283292:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+49:11289:x1874211952959744:12345-192.168.204.52@tcp:101:bash.0 Request processed in 17448us (17695us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787388108.283307:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:2.0:1787388108.291124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.291256:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952960128 00000100:00100000:0.0:1787388108.291266:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952960128 00000100:00100000:0.0:1787388108.291368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:0.0:1787388108.291379:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+49:11289:x1874211952960128:12345-192.168.204.52@tcp:36:bash.0 00010000:00010000:0.0:1787388108.291609:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.291628:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.291639:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388108.291700:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787388108.291723:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005af072f3 reply state 00000000834d4d0f transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.291735:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.291751:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388108.291754:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388108.291758:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388108.291889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+52:11289:x1874211952960128:12345-192.168.204.52@tcp:36:bash.0 Request processed in 511us (775us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787388108.291896:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 68 00000020:00080000:0.0:1787388108.291901:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388108.307391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388108.307505:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952960256 00000100:00100000:2.0:1787388108.307517:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952960256 00000100:00100000:2.0:1787388108.307580:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:2.0:1787388108.307590:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+52:11289:x1874211952960256:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:2.0:1787388108.307617:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388108.307636:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d22 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.307814:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.307834:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.307842:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.307874:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.307886:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 53 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388108.307898:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971921536:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388108.308107:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388108.320187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388108.322277:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971921536:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388108.322333:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388108.323625:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952960384 00000100:00100000:1.0:1787388108.323638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952960384 00010000:00010000:1.0:1787388108.323708:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 54 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388108.324020:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:1.0:1787388108.324032:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+54:2403:x1874211952960384:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388108.324047:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388108.324054:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 54 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.324068:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 54 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.324091:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d1b expref: 54 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.324108:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388108.324113:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.324124:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.324131:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.324183:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388108.324251:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+53:2403:x1874211952960384:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 222us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388108.324260:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 58 00010000:00010000:2.0:1787388108.324503:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.324512:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388108.324564:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787388108.324568:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388108.324587:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.324619:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d22 expref: 53 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.324638:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d22 expref: 52 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.324645:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388108.324648:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388108.324650:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe600, rc 0) 00000100:00100000:2.0:1787388108.324721:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+52:11289:x1874211952960256:12345-192.168.204.52@tcp:101:bash.0 Request processed in 17132us (17341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388108.324728:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:3.0:1787388108.331138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.331315:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952960640 00000100:00100000:0.0:1787388108.331326:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952960640 00000100:00100000:0.0:1787388108.331376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:0.0:1787388108.331386:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+52:11289:x1874211952960640:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:0.0:1787388108.331594:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+53:11289:x1874211952960640:12345-192.168.204.52@tcp:35:bash.0 Request processed in 209us (468us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787388108.331602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:0.0:1787388108.455908:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388108.458183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952960896 00000100:00100000:2.0:1787388108.458199:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952960896 00000100:00100000:2.0:1787388108.458268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 70 00000100:00100000:2.0:1787388108.458279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+53:11299:x1874211952960896:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388108.458303:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388108.458347:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d29 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388108.458444:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787388108.458557:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d29 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.458572:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388108.458575:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388108.458581:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d29 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.458600:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00100000:2.0:1787388108.458674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+54:11299:x1874211952960896:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 397us (2779us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787388108.458721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 70 00000100:00100000:3.0:1787388108.462909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.463135:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952961024 00000100:00100000:0.0:1787388108.463144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952961024 00000100:00100000:0.0:1787388108.463204:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:0.0:1787388108.463215:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+54:11299:x1874211952961024:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:0.0:1787388108.463292:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463320:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463333:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463363:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463371:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463378:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463452:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463468:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388108.463512:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463536:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463543:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463549:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463555:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388108.463559:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463573:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463585:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388108.463588:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388108.463593:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1811fd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463611:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463616:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463621:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463626:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388108.463629:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463634:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463640:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:0.0:1787388108.463643:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388108.463645:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463660:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1811fdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463670:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463675:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463729:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463903:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388108.463909:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463917:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463926:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388108.463928:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388108.463932:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.463938:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1811fe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388108.464027:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+54:11299:x1874211952961024:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 812us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388108.464036:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:3.0:1787388108.466957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.467105:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952961280 00000100:00100000:0.0:1787388108.467115:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952961280 00000100:00100000:0.0:1787388108.467160:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:0.0:1787388108.467169:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+54:11299:x1874211952961280:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388108.467384:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+55:11299:x1874211952961280:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 215us (443us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787388108.467392:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00000040:00080000:3.0:1787388108.488476:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787388108.488991:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388108.501226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388108.501352:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952961536 00000100:00100000:3.0:1787388108.501362:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952961536 00000100:00100000:2.0:1787388108.501447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:2.0:1787388108.501459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+55:11302:x1874211952961536:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388108.501484:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388108.501505:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501628:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501644:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501672:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501750:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501760:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501777:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501887:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812002 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501897:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.501904:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388108.501915:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787388108.502200:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502208:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502214:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502219:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fec00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388108.502230:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502237:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502249:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388108.502253:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388108.502259:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502266:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1811ff4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502280:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502286:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502291:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502295:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffe00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388108.502298:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502303:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502324:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:2.0:1787388108.502326:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388108.502336:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502342:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1811ffb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502383:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1811fed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d30 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502397:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812002 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d30 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.502404:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388108.502406:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388108.502408:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff800, rc 0) 00000100:00100000:2.0:1787388108.502466:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+57:11302:x1874211952961536:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1011us (1250us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787388108.503193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:3.0:1787388108.505929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.506643:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952961664 00000100:00100000:0.0:1787388108.506653:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952961664 00000100:00100000:0.0:1787388108.506750:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 73 00000100:00100000:0.0:1787388108.506761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+57:11302:x1874211952961664:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388108.506845:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.506863:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.506876:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.506911:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.506918:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.506925:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.506931:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388108.507092:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.507101:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.507114:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388108.507117:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388108.507121:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.507128:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388108.507252:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+57:11302:x1874211952961664:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 493us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388108.507261:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 73 00000100:00100000:3.0:1787388108.507743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388108.507795:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952961792 00000100:00100000:1.0:1787388108.507808:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952961792 00000100:00100000:1.0:1787388108.507857:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:1.0:1787388108.507864:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+57:2403:x1874211952961792:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388108.507876:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388108.507892:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812002 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d30 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388108.507905:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388108.507909:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388108.508252:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+56:2403:x1874211952961792:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388108.508260:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:3.0:1787388108.510300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.510412:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952962048 00000100:00100000:0.0:1787388108.510422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952962048 00000100:00100000:0.0:1787388108.510512:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:0.0:1787388108.510532:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+56:11302:x1874211952962048:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388108.510767:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+57:11302:x1874211952962048:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 247us (475us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787388108.510783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:2.0:1787388108.669419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388108.669507:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952962304 00000100:00100000:3.0:1787388108.669517:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952962304 00000100:00100000:3.0:1787388108.669584:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 74 00000100:00100000:3.0:1787388108.669594:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+57:11320:x1874211952962304:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:3.0:1787388108.669618:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388108.669654:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812017 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d37 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.669910:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181201e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.669927:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181201e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.669939:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181201e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388108.669960:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787388108.670063:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812017 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d37 expref: 60 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.670082:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181201e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d37 expref: 59 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.670090:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:3.0:1787388108.670094:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787388108.670097:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496c00, rc 0) 00000100:00100000:3.0:1787388108.670159:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+59:11320:x1874211952962304:12345-192.168.204.52@tcp:101:cat.0 Request processed in 566us (750us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787388108.670166:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 74 00000100:00100000:3.0:1787388108.693886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388108.694406:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952962432 00000100:00100000:2.0:1787388108.694416:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952962432 00000100:00100000:2.0:1787388108.694551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 75 00000100:00100000:2.0:1787388108.694563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+59:11321:x1874211952962432:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388108.694590:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388108.694611:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b181202c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d3e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.694727:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.694757:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.694783:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388108.694843:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787388108.694847:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388108.694865:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.694902:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b181202c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d3e expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.694921:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d3e expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.694929:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388108.694932:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388108.694936:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fec00, rc 0) 00000100:00100000:2.0:1787388108.695354:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+60:11321:x1874211952962432:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 792us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388108.695362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 75 00000100:00100000:0.0:1787388108.699568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388108.699664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952962816 00000100:00100000:1.0:1787388108.699675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952962816 00000100:00100000:1.0:1787388108.700208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:1.0:1787388108.700219:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+60:11321:x1874211952962816:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388108.700512:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+61:11321:x1874211952962816:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 294us (953us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787388108.700521:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:3.0:1787388108.709851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388108.710384:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952962944 00000100:00100000:2.0:1787388108.710395:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952962944 00000100:00100000:2.0:1787388108.710456:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:2.0:1787388108.710466:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+61:11321:x1874211952962944:12345-192.168.204.52@tcp:103:lfs.0 00010000:00010000:2.0:1787388108.710481:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787388108.710523:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1811fc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d22 expref: 61 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.710548:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181201e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d37 expref: 60 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.710560:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1811ec0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cdc expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388108.710568:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388108.710573:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388108.710632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+58:11321:x1874211952962944:12345-192.168.204.52@tcp:103:lfs.0 Request processed in 167us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388108.710640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:3.0:1787388108.721389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388108.721479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952963072 00000100:00100000:0.0:1787388108.721489:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952963072 00000100:00100000:0.0:1787388108.721549:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 76 00000100:00100000:0.0:1787388108.721559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+58:11321:x1874211952963072:12345-192.168.204.52@tcp:58:lfs.0 00010000:00010000:0.0:1787388108.721717:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.721735:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388108.721746:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787388108.722394:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787388108.722535:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787388108.722627:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787388108.722819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+58:11321:x1874211952963072:12345-192.168.204.52@tcp:58:lfs.0 Request processed in 1245us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388108.722836:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 76 00000100:00100000:2.0:1787388108.761548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388108.761661:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952963200 00000100:00100000:3.0:1787388108.761671:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952963200 00000100:00100000:3.0:1787388108.761952:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 77 00000100:00100000:3.0:1787388108.761973:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+58:11323:x1874211952963200:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388108.761994:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388108.762023:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812041 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d45 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762087:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762107:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762119:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762130:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762138:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762146:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762218:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762230:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762237:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388108.762294:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787388108.762298:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388108.762333:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762345:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762354:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762360:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762368:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762375:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388108.762380:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762388:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762400:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:3.0:1787388108.762404:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388108.762408:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762415:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812048 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762441:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762447:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762454:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762460:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388108.762463:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762469:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762478:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:3.0:1787388108.762481:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388108.762484:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762490:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181204f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762516:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812041 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 60 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762529:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 59 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388108.762549:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:3.0:1787388108.762552:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388108.762555:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:3.0:1787388108.762623:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+59:11323:x1874211952963200:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 662us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388108.762631:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 77 00010000:00010000:0.0:1787388108.938049:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388109.320378:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971921664:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.320497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971922176:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.320546:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971922688:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.320586:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971923200:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.320635:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787388109.320641:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971922048:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.320726:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971922560:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.320764:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971923072:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.320785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787388109.321496:0:9921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398305815232ns, next at 399305812903ns, rc = 0 00000100:00100000:0.0:1787388109.323938:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388109.323962:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971923584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388109.324014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324123:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971921792:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324151:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324173:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971922304:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324205:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971922816:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324232:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971923328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388109.324252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324269:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787388109.324274:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971921920:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324314:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971922432:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324344:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971922944:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324368:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971923456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388109.324383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.324423:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971921664 00000100:00100000:0.0:1787388109.324430:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971921664 00000100:00100000:0.0:1787388109.324481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787388109.324489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971921664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92740199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971921664:12345-0@lo:400:kworker.0 Request processed in 45us (4083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.324540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787388109.324568:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922176 00000100:00100000:0.0:1787388109.324571:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922176 00000100:00100000:0.0:1787388109.324584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971923328 00000100:00100000:0.0:1787388109.324586:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971923328 00000100:00100000:0.0:1787388109.324594:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971921920 00000100:00100000:0.0:1787388109.324596:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971921920 00000100:00100000:0.0:1787388109.324604:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787388109.324610:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971922176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324636:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971922176:12345-0@lo:400:kworker.0 Request processed in 27us (4111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.324642:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787388109.324651:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787388109.324656:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971923328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388109.324696:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:0.0:1787388109.324727:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971923328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.324733:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787388109.324743:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787388109.324748:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971921920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.324768:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971921920:12345-0@lo:400:kworker.0 Request processed in 20us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.324780:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388109.325198:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971923200 00000100:00100000:3.0:1787388109.325203:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971923200 00000100:00100000:3.0:1787388109.325241:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971923072 00000100:00100000:3.0:1787388109.325243:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971923072 00000100:00100000:3.0:1787388109.325253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922304 00000100:00100000:3.0:1787388109.325255:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922304 00000100:00100000:3.0:1787388109.325265:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922432 00000100:00100000:3.0:1787388109.325266:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922432 00000100:00100000:3.0:1787388109.325278:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388109.325284:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971923200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325329:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971923200:12345-0@lo:400:kworker.0 Request processed in 46us (4719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325335:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388109.325347:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787388109.325352:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971923072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325372:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971923072:12345-0@lo:400:kworker.0 Request processed in 20us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325376:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787388109.325384:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787388109.325396:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971922304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325417:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971922304:12345-0@lo:400:kworker.0 Request processed in 22us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325422:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787388109.325431:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787388109.325436:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971922432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325454:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971922432:12345-0@lo:400:kworker.0 Request processed in 19us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325459:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787388109.325474:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922688 00000100:00100000:3.0:1787388109.325477:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922688 00000100:00100000:3.0:1787388109.325492:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922048 00000100:00100000:3.0:1787388109.325495:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922048 00000100:00100000:3.0:1787388109.325503:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922560 00000100:00100000:3.0:1787388109.325506:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922560 00000100:00100000:3.0:1787388109.325514:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971921792 00000100:00100000:3.0:1787388109.325516:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971921792 00000100:00100000:3.0:1787388109.325524:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922816 00000100:00100000:3.0:1787388109.325526:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922816 00000100:00100000:3.0:1787388109.325535:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971922944 00000100:00100000:3.0:1787388109.325537:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971922944 00000100:00100000:3.0:1787388109.325547:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787388109.325552:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971922688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325576:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971922688:12345-0@lo:400:kworker.0 Request processed in 23us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325581:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787388109.325590:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787388109.325595:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971922048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325634:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971922048:12345-0@lo:400:kworker.0 Request processed in 39us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325640:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787388109.325650:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787388109.325655:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971922560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325674:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971922560:12345-0@lo:400:kworker.0 Request processed in 20us (4925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325693:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787388109.325703:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787388109.325708:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971921792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325729:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971921792:12345-0@lo:400:kworker.0 Request processed in 21us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325734:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787388109.325742:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787388109.325747:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971922816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.325765:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971922816:12345-0@lo:400:kworker.0 Request processed in 17us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.325771:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787388109.325781:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787388109.325786:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971922944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.326153:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971922944:12345-0@lo:400:kworker.0 Request processed in 367us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.326160:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787388109.326180:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971923584 00000100:00100000:3.0:1787388109.326184:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971923584 00000100:00100000:3.0:1787388109.326211:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971923456 00000100:00100000:3.0:1787388109.326214:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971923456 00000100:00100000:3.0:1787388109.326224:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787388109.326228:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971923584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388109.326246:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787388109.326271:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971923584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.326277:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787388109.326287:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787388109.326307:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971923456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388109.326314:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787388109.326334:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971923456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.326339:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1787388109.327023:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388109.327030:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388109.327033:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388109.327035:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388109.328543:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971921920:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.328568:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971922432:0@lo:400:kworker.0 00010000:00080000:3.0:1787388109.328583:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6836300 x1874211971922944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388109.328592:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971922944:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.328612:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971923456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388109.328625:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971921792:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.328635:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971922304:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.328645:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971922816:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.328673:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971923328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388109.330171:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971923584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388109.330201:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971922048:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.330213:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971922560:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.330223:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971923072:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.330232:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971921664:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.330243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971922176:0@lo:400:kworker.0 00010000:00080000:3.0:1787388109.330256:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6834000 x1874211971922688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388109.330266:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971922688:0@lo:400:kworker.0 00000100:00100000:3.0:1787388109.330276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971923200:0@lo:400:kworker.0 00000004:00080000:0.0:1787388109.334837:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787388109.334888:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1787388109.334939:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787388109.334948:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9273c2db63c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787388109.334953:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c37f5700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9273c2db6540 00000020:00080000:0.0:1787388109.334956:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c37f5300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c2d80600 00000100:00100000:1.0:1787388109.334988:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971923712:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787388109.335002:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335013:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335020:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335026:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.335031:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335038:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335068:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9273d8f07000) 00010000:00010000:0.0:1787388109.335071:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.335076:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335082:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1811dfc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335122:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335128:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335133:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.335135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388109.335139:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.335142:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335148:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335155:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388109.335158:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.335161:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335165:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1811e03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335176:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335182:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.335185:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971923712 00010000:00010000:0.0:1787388109.335188:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.335191:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971923712 00010000:00010000:0.0:1787388109.335198:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.335200:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335206:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335213:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07300) 00010000:00010000:0.0:1787388109.335215:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.335218:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335224:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1811e42 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335240:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.335246:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787388109.335246:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335251:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.335255:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971923712:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787388109.335257:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.335260:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335265:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787388109.335280:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:0.0:1787388109.335282:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388109.335284:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.335286:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335312:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1811f4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388109.335321:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8960ca, atime: 0x6a8960cb, ctime: 0x6a8960ca, blocks: 0x8 00010000:00010000:0.0:1787388109.335324:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335328:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335330:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335336:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335341:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1787388109.335341:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.335343:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335346:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388109.335349:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335352:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335356:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388109.335359:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.335361:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335366:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335367:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1811f6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335375:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335383:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335386:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335393:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335399:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335404:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.335407:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335409:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388109.335413:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335420:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388109.335422:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.335424:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.335429:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1811fb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787388109.335444:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1787388109.335541:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971923712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (404us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787388109.335548:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787388109.335568:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1787388109.335571:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787388109.335574:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335581:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388109.335585:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335592:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335606:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335612:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8dd3e56/0x5cb77467b181205d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.335626:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388109.335628:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388109.335630:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787388109.335657:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9273d067c380/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787388109.335663:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971923712:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1787388109.512448:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388109.512459:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388109.513728:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787388109.513744:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388109.515078:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971923840:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388109.515190:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388109.520536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.521009:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952963328 00000100:00100000:2.0:1787388109.521019:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952963328 00000100:00100000:3.0:1787388109.521055:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971923840:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388109.521206:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 78 00000100:00100000:2.0:1787388109.521217:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+12:11334:x1874211952963328:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388109.521248:0:9533:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388109.521372:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+12:11334:x1874211952963328:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 157us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.521380:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 78 00000100:00100000:2.0:1787388109.525709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.525805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952963456 00000100:00100000:0.0:1787388109.525815:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952963456 00000100:00100000:0.0:1787388109.525876:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:0.0:1787388109.525887:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+12:11334:x1874211952963456:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787388109.525964:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.525981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.526003:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.526041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.526048:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.527919:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.527962:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.527974:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.527980:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388109.528035:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787388109.528040:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388109.528251:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528264:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528278:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528283:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528299:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.528304:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528312:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528323:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:0.0:1787388109.528326:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.528330:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528337:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812064 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528353:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528358:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528363:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528368:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.528377:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528383:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9273e13c5500) 00010000:00010000:0.0:1787388109.528394:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.528397:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528402:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b181206b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528417:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528422:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528427:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528431:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.528433:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528439:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528446:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388109.528448:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.528456:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.528463:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812072 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388109.528557:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+12:11334:x1874211952963456:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 Request processed in 2669us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.528567:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:0.0:1787388109.541557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.546514:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952963712 00000100:00100000:2.0:1787388109.546529:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952963712 00000100:00100000:2.0:1787388109.546635:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00100000:2.0:1787388109.546646:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+12:11334:x1874211952963712:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388109.546674:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388109.546719:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812079 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d4c expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546843:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546857:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546868:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388109.546880:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787388109.546957:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546963:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546968:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546973:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388109.546976:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546983:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.546994:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388109.547016:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388109.547022:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.547028:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812080 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.548457:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812079 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d4c expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.548477:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:2.0:1787388109.548480:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388109.548485:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812079 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d4c expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.548497:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff800, rc 0) 00000100:00100000:2.0:1787388109.548566:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+13:11334:x1874211952963712:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 1921us (7018us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1787388109.548575:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00100000:2.0:1787388109.552521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.553517:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952963840 00000100:00100000:0.0:1787388109.553528:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952963840 00000100:00100000:0.0:1787388109.553588:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 81 00000100:00100000:0.0:1787388109.553598:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+13:11334:x1874211952963840:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388109.553726:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388109.553859:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+13:11334:x1874211952963840:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 262us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.553868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 81 00000100:00100000:1.0:1787388109.568102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.568172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952964096 00000100:00100000:0.0:1787388109.568182:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952964096 00000100:00100000:0.0:1787388109.568241:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 82 00000100:00100000:0.0:1787388109.568252:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+13:11334:x1874211952964096:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388109.568272:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388109.568276:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787388109.568313:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d3e expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.568331:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388109.568342:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388109.568358:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181208e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d53 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388109.569187:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787388109.569425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812095 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.569440:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.569451:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.569508:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181208e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d53 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.569523:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812095 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d53 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.569531:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273e13c5500) 00010000:00010000:0.0:1787388109.569534:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388109.569537:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafba00, rc 0) 00000100:00100000:0.0:1787388109.569604:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952964096:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 1354us (1511us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787388109.569613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 82 00000100:00100000:1.0:1787388109.590537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.591894:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952964352 00000100:00100000:2.0:1787388109.591907:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952964352 00000100:00100000:2.0:1787388109.591970:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 83 00000100:00100000:2.0:1787388109.591982:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952964352:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388109.592052:0:13489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388109.592081:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812095 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d53 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592114:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273e13c5500) 00010000:00010000:2.0:1787388109.592125:0:13489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388109.592266:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592280:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592300:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592316:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592323:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592330:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592372:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592379:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592386:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592392:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388109.592396:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592745:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592755:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388109.592758:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388109.592762:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592768:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b18120a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592780:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592786:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592804:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592810:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388109.592813:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592820:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.592828:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6bb674d (ffff9273d8f07800) 00010000:00010000:2.0:1787388109.592831:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388109.593899:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.593927:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18120aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6bb674d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388109.594030:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+13:11334:x1874211952964352:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 2048us (3499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388109.594039:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 83 00000100:00100000:2.0:1787388109.603052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388109.603142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952964480 00000100:00100000:3.0:1787388109.603153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952964480 00000100:00100000:3.0:1787388109.603211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 84 00000100:00100000:3.0:1787388109.603233:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+13:11334:x1874211952964480:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388109.603254:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388109.603277:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.603326:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.603339:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.603349:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.603465:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.603483:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.603493:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:3.0:1787388109.603496:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388109.603499:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496e00, rc 0) 00000100:00100000:3.0:1787388109.603567:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952964480:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 335us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.603575:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 84 00000100:00100000:1.0:1787388109.619634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388109.619875:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952964736 00000100:00100000:3.0:1787388109.619885:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952964736 00000100:00100000:3.0:1787388109.619948:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 85 00000100:00100000:3.0:1787388109.619979:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952964736:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388109.620058:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.620076:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.620088:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388109.620252:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787388109.620262:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398604582527ns, next at 399604579996ns, rc = 0 00000004:00010000:3.0:1787388109.620325:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4e0222d reply state 00000000549c86f7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.620338:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.620347:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:3.0:1787388109.620350:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787388109.620354:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388109.620742:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+16:11334:x1874211952964736:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 778us (1117us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787388109.620819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 85 00000100:00100000:3.0:1787388109.632158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.635757:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952964864 00000100:00100000:0.0:1787388109.635773:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952964864 00000100:00100000:0.0:1787388109.635855:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 86 00000100:00100000:0.0:1787388109.635866:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+16:11334:x1874211952964864:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388109.635896:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388109.635918:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d61 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.635991:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 17 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.636007:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 17 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.636026:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:0.0:1787388109.636028:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388109.636033:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa600, rc 0) 00000100:00100000:0.0:1787388109.636093:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+17:11334:x1874211952964864:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 229us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.636100:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 86 00000100:00100000:3.0:1787388109.641013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.644934:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952964992 00000100:00100000:2.0:1787388109.644951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952964992 00000100:00100000:2.0:1787388109.645078:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:2.0:1787388109.645086:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874211952964992:12345-192.168.204.52@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787388109.645117:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:2.0:1787388109.645151:0:8437:0:(genops.c:1406:class_connect()) connect: client 74df45bd-a066-4da5-9401-b0a043132784, cookie 0x5cb77467b18120cd 00002000:00100000:2.0:1787388109.645163:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74df45bd-a066-4da5-9401-b0a043132784/ffff9273c8ad7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388109.645181:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 76, return 76 00002000:00080000:2.0:1787388109.645259:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388109.645302:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9273c8ad7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388109.645385:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2400:x1874211952964992:12345-192.168.204.52@tcp:8:lhsmtool_posix.0 Request processed in 297us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.645392:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:1.0:1787388109.653948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.654114:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952965120 00000100:00100000:0.0:1787388109.654124:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952965120 00000100:00100000:0.0:1787388109.654192:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:0.0:1787388109.654201:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:0:x1874211952965120:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787388109.656515:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388109.659382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.659415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.659445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.659552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.659579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.659619:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952965760 00000100:00100000:2.0:1787388109.659629:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952965760 00000100:00100000:2.0:1787388109.660017:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952965376 00000100:00100000:2.0:1787388109.660022:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952965376 00000100:00100000:2.0:1787388109.660126:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952965632 00000100:00100000:2.0:1787388109.660131:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952965632 00000100:00100000:2.0:1787388109.660160:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 281 00000100:00100000:2.0:1787388109.660170:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952965760:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388109.660244:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952965760:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 76us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.660252:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 281 00000100:00100000:2.0:1787388109.660271:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 282 00000100:00100000:2.0:1787388109.660278:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952965376:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388109.660319:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952965376:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 42us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.660325:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 282 00000100:00100000:2.0:1787388109.660338:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 283 00000100:00100000:2.0:1787388109.660345:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952965632:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388109.660371:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952965632:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.660377:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 283 00000100:00080000:2.0:1787388109.660403:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388109.660406:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388109.660631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952965248 00000100:00100000:1.0:1787388109.660637:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952965248 00000100:00100000:1.0:1787388109.660699:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 380 00000100:00100000:1.0:1787388109.660709:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952965248:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388109.660741:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952965248:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 35us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.660760:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 380 00000100:00100000:0.0:1787388109.661154:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952965504 00000100:00100000:0.0:1787388109.661159:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952965504 00000100:00100000:0.0:1787388109.661207:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 114 00000100:00100000:0.0:1787388109.661214:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952965504:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388109.661247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952965504:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 34us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.661264:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 114 00000100:00080000:2.0:1787388109.661318:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787388109.662157:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1787388109.662169:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000100:00100000:2.0:1787388109.664208:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:0:x1874211952965120:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 9997us (10259us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787388109.664232:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:0.0:1787388109.673573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.679946:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952966016 00000100:00100000:1.0:1787388109.679959:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952966016 00000100:00100000:1.0:1787388109.680019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787388109.680028:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+17:11334:x1874211952966016:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388109.680476:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+18:11334:x1874211952966016:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 447us (6912us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787388109.680485:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787388109.688711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388109.689751:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952966272 00000100:00100000:3.0:1787388109.689763:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952966272 00000100:00100000:3.0:1787388109.689814:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 87 00000100:00100000:3.0:1787388109.689825:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+18:11334:x1874211952966272:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388109.689949:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+18:11334:x1874211952966272:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 125us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.689957:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 87 00000100:00100000:2.0:1787388109.700775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.701016:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952966400 00000100:00100000:1.0:1787388109.701028:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952966400 00000100:00100000:1.0:1787388109.701086:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 88 00000100:00100000:1.0:1787388109.701096:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+18:11334:x1874211952966400:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388109.701116:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388109.701153:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18120d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d68 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.701223:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18120db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.701237:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18120db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.701250:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18120db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388109.701305:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388109.701325:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18120db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.701353:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18120d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d68 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.701369:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18120db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d68 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.701377:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:1.0:1787388109.701380:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388109.701383:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4c00, rc 0) 00000100:00100000:1.0:1787388109.701445:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+19:11334:x1874211952966400:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 350us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.701453:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 88 00000040:00080000:0.0:1787388109.705852:0:14213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388109.705862:0:14213:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388109.705888:0:14213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787388109.705895:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388109.713161:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.713327:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952966528 00000100:00100000:1.0:1787388109.713336:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952966528 00000100:00100000:1.0:1787388109.713440:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:1.0:1787388109.713451:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952966528:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388109.713469:0:10361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388109.713492:0:10361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d6f expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388109.713518:0:10361:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960cd, blocks: 0x0 00010000:00010000:1.0:1787388109.713537:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1787388109.713541:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388109.713551:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 6 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.713570:0:10361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 6 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.713597:0:10361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b5a00, rc 0) 00000100:00100000:1.0:1787388109.713657:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952966528:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 207us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.713665:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:3.0:1787388109.719382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.720133:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952966784 00000100:00100000:2.0:1787388109.720144:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952966784 00000100:00100000:2.0:1787388109.720210:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 89 00000100:00100000:2.0:1787388109.720220:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+19:11334:x1874211952966784:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787388109.720347:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+19:11334:x1874211952966784:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 127us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.720356:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 89 00000100:00100000:2.0:1787388109.734143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.734191:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952966912 00000100:00100000:2.0:1787388109.734200:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952966912 00000100:00100000:2.0:1787388109.734257:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 38 00000100:00100000:2.0:1787388109.734267:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:11334:x1874211952966912:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388109.734294:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388109.734315:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d76 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.734357:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.734365:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388109.734370:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388109.734376:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.734421:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.734436:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388109.734450:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971923968:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388109.734527:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787388109.739494:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971923968:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388109.739530:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.739553:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe600, rc 0) 00000100:00100000:0.0:1787388109.739856:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:11334:x1874211952966912:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 5589us (5718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.739865:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 38 00000100:00100000:3.0:1787388109.743259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388109.743927:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952967040 00000100:00100000:3.0:1787388109.743938:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952967040 00010000:00010000:3.0:1787388109.743982:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388109.744022:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:3.0:1787388109.744032:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952967040:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388109.744045:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388109.744067:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.744081:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.744107:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091c2cd82/0x5cb77467b18120e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d6f expref: 7 pid: 10361 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.744125:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388109.744129:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388109.744137:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.744162:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.744198:0:7461:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388109.744211:0:7461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6862d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7461:1874211971924096:192.168.204.52@tcp:105: 00000100:00100000:3.0:1787388109.744317:0:7461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388109.748604:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388109.748629:0:7461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6862d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7461:1874211971924096:192.168.204.52@tcp:105: 00010000:00010000:3.0:1787388109.748662:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388109.748767:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952967040:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 4734us (5519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.748778:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:0.0:1787388109.748834:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952967168 00000100:00100000:0.0:1787388109.748843:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952967168 00002000:00100000:0.0:1787388109.749000:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9272c3c54380 x1874211952967168/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:365/0 lens 504/0 e 0 to 0 dl 1787388120 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388109.749010:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3c54380 with x1874211952967168 ext(0->8) 00002000:00010000:0.0:1787388109.749016:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3c54380 00000100:00100000:0.0:1787388109.749041:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:0.0:1787388109.749050:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952967168:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787388109.750139:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2402:x1874211952967168:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 Request processed in 1083us (1550us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787388109.750158:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00002000:00100000:0.0:1787388109.750167:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9272c3c54380 x1874211952967168/t4294967303(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:365/0 lens 504/448 e 0 to 0 dl 1787388120 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388109.750177:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3c54380 with x1874211952967168 ext(0->8) 00002000:00010000:0.0:1787388109.750182:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3c54380 00000100:00100000:0.0:1787388109.760229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.760995:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952967296 00000100:00100000:1.0:1787388109.761006:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952967296 00000100:00100000:1.0:1787388109.761065:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 90 00000100:00100000:1.0:1787388109.761075:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:11334:x1874211952967296:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388109.763126:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1787388109.763142:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787388109.763168:0:6499:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1787388109.763189:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787388109.763198:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1787388109.763340:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.763352:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.763359:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.763365:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.763369:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.763378:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.763394:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:0.0:1787388109.763397:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787388109.763401:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.763408:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18120bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388109.763633:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388109.763652:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971924224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787388109.763661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952967296:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 Request processed in 2582us (3436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.763672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 90 00000100:00100000:0.0:1787388109.763737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.763791:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971924224 00000100:00100000:0.0:1787388109.763799:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971924224 00000100:00100000:0.0:1787388109.763836:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787388109.763845:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971924224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787388109.763950:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787388109.763954:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787388109 00002000:00010000:0.0:1787388109.763957:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787388109.763959:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787388109 -> 1787388109 00002000:00010000:0.0:1787388109.763961:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787388109.764006:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971924224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (269us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787388109.764013:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:1.0:1787388109.764508:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9273d067ca80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787388109.764516:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971924224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787388109.766747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.766843:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952967424 00000100:00100000:1.0:1787388109.766853:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952967424 00000100:00100000:1.0:1787388109.766919:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:1.0:1787388109.766931:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211952967424:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787388109.769937:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787388109.769950:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787388109.770129:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952967424:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 Request processed in 3194us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.770142:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:1.0:1787388109.777524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.779134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952967680 00000100:00100000:2.0:1787388109.779147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952967680 00000100:00100000:2.0:1787388109.779214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 91 00000100:00100000:2.0:1787388109.779223:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952967680:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388109.779277:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388109.779313:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18120db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d68 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.779331:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:2.0:1787388109.779335:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388109.779367:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.779381:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.779391:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388109.779526:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000870b9f36 reply state 0000000037cdf5d3 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.779537:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.779543:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:2.0:1787388109.779546:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388109.779548:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388109.779656:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+15:11334:x1874211952967680:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 434us (2142us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787388109.779663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 91 00000100:00100000:0.0:1787388109.787816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.789107:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952967808 00000100:00100000:1.0:1787388109.789118:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952967808 00000100:00100000:0.0:1787388109.789337:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:0.0:1787388109.789348:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952967808:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787388109.789508:0:10361:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787388109.789512:0:10361:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787388109 -> 1787388108 00002000:00010000:0.0:1787388109.789514:0:10361:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787388107 00002000:00010000:0.0:1787388109.789516:0:10361:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787388109 -> 1787388108 00002000:00010000:0.0:1787388109.789519:0:10361:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787388109.789589:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952967808:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 242us (1783us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787388109.789610:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:1.0:1787388109.793310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.793406:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968064 00000100:00100000:0.0:1787388109.793416:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968064 00000100:00100000:0.0:1787388109.793479:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 92 00000100:00100000:0.0:1787388109.793490:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+15:11334:x1874211952968064:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787388109.793559:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.793575:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.793585:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.793632:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.793647:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 15 pid: 6520 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388109.793661:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971924352:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388109.793777:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388109.796116:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971924352:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388109.796144:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.797060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.797131:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968192 00000100:00100000:2.0:1787388109.797139:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968192 00010000:00010000:2.0:1787388109.797173:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 16 pid: 6520 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388109.797208:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:2.0:1787388109.797217:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+16:2404:x1874211952968192:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388109.797232:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388109.797239:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 16 pid: 6520 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.797250:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 16 pid: 6520 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.797271:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18120b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d5a expref: 16 pid: 6520 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.797308:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:2.0:1787388109.797313:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.797323:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.797330:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.797363:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388109.797414:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+15:2404:x1874211952968192:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 198us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.797422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 60 00010000:00010000:1.0:1787388109.797556:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797564:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797600:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797608:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797613:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797619:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388109.797630:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797638:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797647:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:1.0:1787388109.797650:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787388109.797653:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.797659:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18120f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.797742:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952968064:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 Request processed in 4253us (4440us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787388109.797750:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 92 00000100:00100000:3.0:1787388109.800087:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388109.800157:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968320 00000100:00100000:0.0:1787388109.800174:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968320 00000100:00100000:0.0:1787388109.800229:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:0.0:1787388109.800239:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952968320:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787388109.800294:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.800314:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.800322:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388109.800326:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388109.800331:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.800364:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.800377:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 7 pid: 8437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388109.800393:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971924480:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388109.800463:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388109.807239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.808538:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968448 00000100:00100000:1.0:1787388109.808549:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968448 00010000:00010000:1.0:1787388109.808591:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 8 pid: 8437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.808643:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:1.0:1787388109.808654:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211952968448:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388109.808670:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388109.808712:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 8 pid: 8437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.808726:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 8 pid: 8437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.808772:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388109.808777:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388109.808783:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.808793:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.808814:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388109.808872:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211952968448:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 220us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.808880:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 61 00010000:00010000:3.0:1787388109.812393:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b18120e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d76 expref: 7 pid: 8437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388109.812434:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971924480:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388109.812464:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812476:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812484:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812515:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812523:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812532:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812540:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388109.812544:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812554:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812594:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388109.812602:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18120fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388109.812732:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952968320:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 Request processed in 12491us (12648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.812743:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:3.0:1787388109.822252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.822339:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968704 00000100:00100000:1.0:1787388109.822349:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968704 00000100:00100000:1.0:1787388109.822408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 93 00000100:00100000:1.0:1787388109.822418:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+14:11334:x1874211952968704:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787388109.822497:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.822514:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.822524:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.822556:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.822580:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 14 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.822596:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971924608:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388109.822667:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787388109.824634:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971924608:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388109.824664:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388109.826838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388109.827227:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968832 00000100:00100000:2.0:1787388109.827237:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968832 00010000:00010000:2.0:1787388109.827274:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 15 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388109.827361:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:2.0:1787388109.827372:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+15:2404:x1874211952968832:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388109.827386:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388109.827393:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 15 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.827406:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 15 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.827437:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1811f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4cff expref: 15 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.827451:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:2.0:1787388109.827457:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.827466:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.827473:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388109.827510:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388109.827559:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+14:2404:x1874211952968832:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 189us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.827568:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 62 00010000:00010000:1.0:1787388109.827649:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.827658:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.827869:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.827882:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.827891:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.827918:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.827931:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 14 pid: 13489 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.827944:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971924736:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388109.828013:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388109.830452:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971924736:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388109.830481:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388109.830669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.830797:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952968960 00000100:00100000:1.0:1787388109.830805:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952968960 00010000:00010000:1.0:1787388109.830838:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 15 pid: 13489 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.830878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:1.0:1787388109.830887:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+15:2403:x1874211952968960:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388109.830900:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388109.830907:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 15 pid: 13489 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.830918:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 15 pid: 13489 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.830942:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18120c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d61 expref: 15 pid: 13489 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.830958:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:1.0:1787388109.830963:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.830973:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.830991:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.831016:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388109.831063:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+14:2403:x1874211952968960:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 176us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.831070:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00010000:00010000:1.0:1787388109.831096:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.831102:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388109.831218:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1787388109.831353:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1787388109.831408:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1787388109.831481:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971924864:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787388109.831529:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388109.831562:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c8da3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388109.833498:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971924864 00000100:00100000:2.0:1787388109.833510:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971924864 00000100:00100000:2.0:1787388109.834073:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787388109.834085:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1874211971924864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787388109.834216:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1874211971924864:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.834225:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787388109.834315:0:6521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787388109.834322:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9273d067ca80, transno 4294967304 00000100:00100000:1.0:1787388109.834344:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971924864:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787388109.834482:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787388109.834550:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971924992:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787388109.834587:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388109.834615:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388109.834666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971924992 00000100:00100000:0.0:1787388109.834715:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971924992 00000100:00100000:0.0:1787388109.834753:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787388109.834760:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1874211971924992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787388109.834873:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971924992:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (285us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787388109.834881:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787388109.834931:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971924992:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787388109.834975:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.834985:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.834992:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.834999:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388109.835003:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835010:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835026:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:1.0:1787388109.835030:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388109.835034:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835039:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181210c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835063:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835068:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835072:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835085:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388109.835088:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835093:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835100:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388109.835102:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388109.835105:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835110:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181203a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835129:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835142:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835150:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835172:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.835185:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 17 pid: 9533 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.835207:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971925120:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388109.835270:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2a42840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388109.840883:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971925120:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388109.840911:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388109.841436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.841509:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952969088 00000100:00100000:1.0:1787388109.841517:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952969088 00010000:00010000:1.0:1787388109.841548:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 18 pid: 9533 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388109.841706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:1.0:1787388109.841716:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+18:2403:x1874211952969088:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388109.841731:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388109.841738:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 18 pid: 9533 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.841762:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 18 pid: 9533 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.841792:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d45 expref: 18 pid: 9533 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.841806:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:1.0:1787388109.841810:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.841827:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.841834:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.841859:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388109.841909:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+17:2403:x1874211952969088:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.841917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 64 00010000:00010000:0.0:1787388109.843566:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843580:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843595:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843601:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843608:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843614:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.843617:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843623:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843638:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388109.843642:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388109.843646:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812113 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843675:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843697:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843705:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843711:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388109.843714:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843721:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843731:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273da1a0900) 00010000:00010000:0.0:1787388109.843734:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388109.843737:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.843743:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812105 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388109.843997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+16:11334:x1874211952968704:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 21575us (21749us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787388109.844009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 93 00000020:00080000:0.0:1787388109.844021:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787388109.845221:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388109.845228:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388109.845261:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787388109.845267:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388109.847443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388109.847767:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952969344 00000100:00100000:1.0:1787388109.847784:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952969344 00000100:00100000:1.0:1787388109.847837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787388109.847846:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+16:11334:x1874211952969344:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787388109.848378:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787388109.848405:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1787388109.848436:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.848451:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.848461:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.848471:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.848477:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.848491:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388109.848516:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388109.848594:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+18:11334:x1874211952969344:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 748us (1160us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787388109.848602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000020:00080000:1.0:1787388109.848606:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787388109.849350:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388109.849359:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.849367:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388109.849372:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.849380:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.849394:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:0.0:1787388109.849397:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787388109.849400:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.849406:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181211a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388109.849420:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388109.849421:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388109.849423:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388109.963102:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388110.984068:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388111.635168:0:14264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388111.635177:0:14264:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388111.635279:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787388111.635288:0:14264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388111.750942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388111.751047:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952969600 00000100:00100000:2.0:1787388111.751059:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952969600 00000100:00100000:2.0:1787388111.751141:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 94 00000100:00100000:2.0:1787388111.751152:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+18:11352:x1874211952969600:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388111.751181:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388111.751203:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d7d expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787388111.751315:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787388111.751323:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812128 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.751337:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812128 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.751350:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812128 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388111.751361:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787388111.751468:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d7d expref: 21 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.751487:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812128 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d7d expref: 20 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.751496:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388111.751499:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787388111.751509:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe600, rc 0) 00000100:00100000:2.0:1787388111.751621:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+20:11352:x1874211952969600:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 470us (688us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787388111.751629:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 94 00000100:00100000:2.0:1787388111.756005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388111.756096:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952969728 00000100:00100000:1.0:1787388111.756106:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952969728 00000100:00100000:1.0:1787388111.756186:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 95 00000100:00100000:1.0:1787388111.756196:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+20:11352:x1874211952969728:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:1.0:1787388111.756315:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756330:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756341:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756353:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756360:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756366:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756453:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756462:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756468:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388111.756513:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756526:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756532:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756538:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756544:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388111.756548:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756556:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756567:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388111.756570:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388111.756574:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756587:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812136 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756598:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756602:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756607:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756612:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388111.756614:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756620:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756628:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d13bf700) 00010000:00010000:1.0:1787388111.756630:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388111.756633:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756639:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b181213d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756653:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756659:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756672:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756732:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388111.756735:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756742:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756751:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:1.0:1787388111.756754:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388111.756756:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.756763:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388111.756844:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+20:11352:x1874211952969728:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 648us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388111.756852:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 95 00000100:00100000:3.0:1787388111.817070:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388111.817236:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952969984 00000100:00100000:0.0:1787388111.817255:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952969984 00000100:00100000:0.0:1787388111.817321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 96 00000100:00100000:0.0:1787388111.817348:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+20:11355:x1874211952969984:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388111.817370:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388111.817393:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181214b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d84 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.817473:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.817498:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.817510:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.817525:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.817533:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.817540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818307:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818320:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818329:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388111.818340:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787388111.818436:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818443:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818449:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818455:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388111.818459:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818466:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388111.818481:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388111.818485:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818492:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812152 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818507:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818513:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818520:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818525:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388111.818536:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818542:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818632:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273e13c5700) 00010000:00010000:1.0:1787388111.818635:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388111.818638:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.818645:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.819055:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181214b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.819074:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.819082:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:1.0:1787388111.819085:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388111.819087:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4600, rc 0) 00000100:00100000:1.0:1787388111.819167:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+22:11355:x1874211952969984:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1821us (2105us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787388111.819176:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 96 00000100:00100000:2.0:1787388111.823132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388111.823304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952970112 00000100:00100000:0.0:1787388111.823315:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952970112 00000100:00100000:0.0:1787388111.823378:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 97 00000100:00100000:0.0:1787388111.823389:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+22:11355:x1874211952970112:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388111.823465:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823481:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823506:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823544:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823631:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823638:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823644:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388111.823648:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823656:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823669:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388111.823672:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388111.823714:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.823721:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181216e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388111.823797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+22:11355:x1874211952970112:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 409us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388111.823806:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 97 00000100:00100000:2.0:1787388111.829145:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388111.832050:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952970368 00000100:00100000:1.0:1787388111.832139:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952970368 00000100:00100000:1.0:1787388111.832323:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:1.0:1787388111.832335:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+22:11355:x1874211952970368:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388111.832671:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+23:11355:x1874211952970368:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 337us (3533us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787388111.832696:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:3.0:1787388111.874809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388111.875476:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952970624 00000100:00100000:0.0:1787388111.875502:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952970624 00000100:00100000:0.0:1787388111.875565:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 98 00000100:00100000:0.0:1787388111.875575:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+23:10873:x1874211952970624:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388111.875602:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388111.875625:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812175 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d8b expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.875790:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.875804:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.875814:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.875847:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.875860:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 24 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388111.875885:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971925248:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388111.875988:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388111.879845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388111.880352:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952970752 00000100:00100000:2.0:1787388111.880363:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952970752 00010000:00010000:2.0:1787388111.880404:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 25 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388111.880441:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 65 00000100:00100000:2.0:1787388111.880450:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+25:2403:x1874211952970752:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388111.880466:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388111.880473:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 25 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.880487:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 25 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.880510:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:2.0:1787388111.880517:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.880873:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.880884:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388111.880920:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388111.880986:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+25:2403:x1874211952970752:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 536us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388111.880995:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 65 00010000:00010000:0.0:1787388111.882171:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b1812160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d84 expref: 24 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388111.882191:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971925248:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388111.882227:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.882237:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.882252:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388111.882273:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787388111.882458:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812175 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.882474:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.882482:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388111.882485:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787388111.882488:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb600, rc 0) 00000100:00100000:0.0:1787388111.882599:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+24:10873:x1874211952970624:12345-192.168.204.52@tcp:101:bash.0 Request processed in 7025us (7801us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787388111.882607:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 98 00000100:00100000:3.0:1787388111.888148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388111.888232:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952970880 00000100:00100000:1.0:1787388111.888251:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952970880 00000100:00100000:1.0:1787388111.888321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 99 00000100:00100000:1.0:1787388111.888331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+24:10873:x1874211952970880:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:1.0:1787388111.888355:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388111.888376:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181218a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d92 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.888414:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.888429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.888442:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.890553:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181218a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d92 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.890581:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d92 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.890591:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:1.0:1787388111.890594:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388111.890610:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4e00, rc 0) 00000100:00100000:1.0:1787388111.890816:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+25:10873:x1874211952970880:12345-192.168.204.52@tcp:101:bash.0 Request processed in 2484us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388111.890825:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 99 00000100:00100000:2.0:1787388111.898948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388111.899134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952971136 00000100:00100000:0.0:1787388111.899145:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952971136 00000100:00100000:0.0:1787388111.899207:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 100 00000100:00100000:0.0:1787388111.899216:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+25:10873:x1874211952971136:12345-192.168.204.52@tcp:36:bash.0 00010000:00010000:0.0:1787388111.899533:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.899561:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.899573:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388111.899626:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1787388111.899651:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bec69088 reply state 0000000079a7ab74 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.899663:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.899671:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388111.899674:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388111.899700:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787388111.899739:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1787388111.899834:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+29:10873:x1874211952971136:12345-192.168.204.52@tcp:36:bash.0 Request processed in 617us (895us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787388111.899841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 100 00000020:00080000:0.0:1787388111.899846:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787388111.903794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388111.904281:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952971264 00000100:00100000:0.0:1787388111.904291:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952971264 00000100:00100000:0.0:1787388111.904385:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 101 00000100:00100000:0.0:1787388111.904396:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+29:10873:x1874211952971264:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388111.904419:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388111.904439:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181219f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4d99 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.904528:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181219f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d99 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.904544:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181219f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d99 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.904562:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388111.904565:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388111.904569:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa600, rc 0) 00000100:00100000:0.0:1787388111.904635:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+30:10873:x1874211952971264:12345-192.168.204.52@tcp:101:bash.0 Request processed in 242us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388111.904643:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 101 00000100:00100000:3.0:1787388111.907292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388111.907396:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952971392 00000100:00100000:0.0:1787388111.907406:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952971392 00000100:00100000:0.0:1787388111.907532:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:0.0:1787388111.907544:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:10873:x1874211952971392:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388111.907561:0:10361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388111.907580:0:10361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4da0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388111.907605:0:10361:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8960cc, atime: 0x6a8960cb, ctime: 0x6a8960cc, blocks: 0x8 00010000:00010000:0.0:1787388111.907627:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787388111.907632:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388111.907640:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 7 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.907715:0:10361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 7 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388111.907729:0:10361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb400, rc 0) 00000100:00100000:0.0:1787388111.907786:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:10873:x1874211952971392:12345-192.168.204.52@tcp:101:bash.0 Request processed in 245us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388111.907794:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00080000:3.0:1787388111.907846:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388111.909984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388111.910514:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952971520 00000100:00100000:3.0:1787388111.910534:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952971520 00002000:00010000:3.0:1787388111.910580:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1787388111.910585:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3db8a80 with x1874211952971520 ext(0->18446744073709551615) 00002000:00010000:3.0:1787388111.910596:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3db8a80. 00000100:00100000:3.0:1787388111.910653:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:3.0:1787388111.910663:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952971520:12345-192.168.204.52@tcp:10:bash.0 00002000:00010000:3.0:1787388111.910971:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787388111.910975:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787388108 -> 1787388111 00002000:00010000:3.0:1787388111.910977:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787388107 -> 1787388107 00002000:00010000:3.0:1787388111.910980:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787388108 -> 1787388111 00002000:00010000:3.0:1787388111.910982:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787388111.911048:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211952971520:12345-192.168.204.52@tcp:10:bash.0 Request processed in 386us (1072us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787388111.911055:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 1 00002000:00010000:3.0:1787388111.911058:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1787388111.911060:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3db8a80 with x1874211952971520 ext(0->18446744073709551615) 00002000:00010000:3.0:1787388111.911064:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3db8a80. 00000100:00100000:2.0:1787388112.005181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.005429:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952971648 00000100:00100000:1.0:1787388112.005439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952971648 00000100:00100000:1.0:1787388112.005500:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 102 00000100:00100000:1.0:1787388112.005511:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+30:11369:x1874211952971648:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:1.0:1787388112.005582:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005599:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005611:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005628:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005636:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005643:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005752:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005762:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005788:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388112.005835:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005849:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005856:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005862:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.005868:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388112.005873:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006425:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006441:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388112.006444:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388112.006449:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006456:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18121ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006472:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006488:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006495:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006499:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388112.006503:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006510:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006519:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d13bf700) 00010000:00010000:1.0:1787388112.006522:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388112.006524:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006530:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18121b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006546:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006552:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006557:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006562:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388112.006572:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006579:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006588:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:1.0:1787388112.006591:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388112.006594:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.006600:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18121bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.006728:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+30:11369:x1874211952971648:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 1216us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.006737:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 102 00010000:00010000:0.0:1787388112.009538:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388112.066491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.067215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952971904 00000100:00100000:0.0:1787388112.067227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952971904 00000100:00100000:0.0:1787388112.067303:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 103 00000100:00100000:0.0:1787388112.067312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+30:11372:x1874211952971904:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388112.067331:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388112.067352:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4da7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067425:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067439:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067452:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067477:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067500:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067506:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067615:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18121d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067624:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18121d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067630:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18121d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388112.067845:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787388112.067938:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067947:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067953:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067959:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388112.067963:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067970:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.067995:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388112.067998:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388112.068002:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068008:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18121c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068024:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068031:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068036:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068042:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388112.068045:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068051:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068058:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273e13c5800) 00010000:00010000:0.0:1787388112.068061:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388112.068063:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068068:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b18121d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068185:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da7 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068200:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18121d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da7 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.068208:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388112.068210:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787388112.068212:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafba00, rc 0) 00000100:00100000:0.0:1787388112.068346:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+32:11372:x1874211952971904:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 980us (1809us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787388112.068355:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 103 00000100:00100000:2.0:1787388112.075581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.075780:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952972032 00000100:00100000:0.0:1787388112.075791:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952972032 00000100:00100000:0.0:1787388112.075853:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 104 00000100:00100000:0.0:1787388112.075864:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+32:11372:x1874211952972032:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388112.075944:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.075960:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 32 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.075970:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.076003:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 32 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.076038:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 32 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388112.076053:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971925376:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388112.076154:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388112.079989:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971925376:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388112.080018:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388112.081940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.082141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952972288 00000100:00100000:0.0:1787388112.082151:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952972288 00000100:00100000:0.0:1787388112.082297:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:0.0:1787388112.082310:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+33:6172:x1874211952972288:12345-192.168.204.52@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1787388112.082565:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:0.0:1787388112.082747:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+35:6172:x1874211952972288:12345-192.168.204.52@tcp:35:ldlm_bl.0 Request processed in 438us (815us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787388112.082755:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 22 00000020:00080000:0.0:1787388112.082761:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388112.087935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.088036:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952972416 00000100:00100000:1.0:1787388112.088046:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952972416 00010000:00010000:1.0:1787388112.088088:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 35 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.088126:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00100000:1.0:1787388112.088135:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+35:2404:x1874211952972416:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388112.088149:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388112.088155:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 35 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.088169:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 35 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.088208:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181217c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d8b expref: 35 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.088228:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:1.0:1787388112.088233:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.088253:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.088260:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.088287:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388112.088337:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+34:2404:x1874211952972416:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 202us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.088344:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 66 00010000:00010000:0.0:1787388112.089866:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089889:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089931:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089956:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089962:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089968:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388112.089973:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089980:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.089995:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388112.089998:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388112.090002:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.090009:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b18121e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388112.090081:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+33:11372:x1874211952972032:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 14216us (14507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388112.090090:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 104 00000100:00100000:2.0:1787388112.097642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.098043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952972672 00000100:00100000:1.0:1787388112.098053:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952972672 00000100:00100000:1.0:1787388112.098125:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787388112.098136:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+33:11372:x1874211952972672:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388112.098383:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+34:11372:x1874211952972672:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 249us (751us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787388112.098392:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787388112.192174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.192279:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952972928 00000100:00100000:2.0:1787388112.192291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952972928 00000100:00100000:2.0:1787388112.192355:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 105 00000100:00100000:2.0:1787388112.192366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+34:11383:x1874211952972928:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:2.0:1787388112.192393:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388112.192416:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18121ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dae expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192509:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192534:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192547:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192579:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192588:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192595:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192759:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192768:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192776:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388112.192786:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787388112.192862:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192869:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192889:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192895:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fec00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388112.192900:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192917:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192929:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388112.192932:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388112.192937:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192942:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18121f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192955:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192961:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192966:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192971:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388112.192974:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192980:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.192988:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07c00) 00010000:00010000:2.0:1787388112.192990:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388112.192993:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.193008:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18121fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.193048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18121ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dae expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.193061:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dae expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.193068:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:2.0:1787388112.193071:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388112.193073:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff400, rc 0) 00000100:00100000:2.0:1787388112.193136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+36:11383:x1874211952972928:12345-192.168.204.52@tcp:101:cat.0 Request processed in 773us (971us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787388112.193144:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 105 00000100:00100000:2.0:1787388112.202145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.202398:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952973184 00000100:00100000:1.0:1787388112.202409:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952973184 00000100:00100000:1.0:1787388112.202497:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:1.0:1787388112.202510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+36:11383:x1874211952973184:12345-192.168.204.52@tcp:35:cat.0 00000100:00100000:1.0:1787388112.203360:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+37:11383:x1874211952973184:12345-192.168.204.52@tcp:35:cat.0 Request processed in 848us (1221us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787388112.203371:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:3.0:1787388112.213349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.213398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.213513:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952973440 00000100:00100000:1.0:1787388112.213532:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952973440 00000100:00100000:1.0:1787388112.213590:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:1.0:1787388112.213601:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211952973440:12345-192.168.204.52@tcp:16:kworker.0 00000100:00100000:0.0:1787388112.217263:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952973312 00000100:00100000:0.0:1787388112.217279:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952973312 00002000:00100000:0.0:1787388112.217337:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9273c6837100 x1874211952973312/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:368/0 lens 496/0 e 0 to 0 dl 1787388123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388112.217348:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273c6837100 with x1874211952973312 ext(0->7) 00002000:00010000:0.0:1787388112.217365:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9273c6837100 00000100:00100000:0.0:1787388112.217407:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:0.0:1787388112.217417:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+9:2404:x1874211952973312:12345-192.168.204.52@tcp:4:cat.0 00000100:00100000:0.0:1787388112.220162:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+11:2404:x1874211952973312:12345-192.168.204.52@tcp:4:cat.0 Request processed in 2736us (6752us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787388112.220177:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 2 00002000:00100000:0.0:1787388112.220189:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9273c6837100 x1874211952973312/t4294967308(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:368/0 lens 496/448 e 0 to 0 dl 1787388123 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388112.220198:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273c6837100 with x1874211952973312 ext(0->7) 00002000:00010000:0.0:1787388112.220205:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9273c6837100 00000001:00080000:2.0:1787388112.221079:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787388112.221089:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1787388112.221246:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211952973440:12345-192.168.204.52@tcp:16:kworker.0 Request processed in 7634us (7895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.221256:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:3.0:1787388112.236659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.237023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952973696 00000100:00100000:2.0:1787388112.237034:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952973696 00000100:00100000:2.0:1787388112.237098:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 106 00000100:00100000:2.0:1787388112.237109:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+37:11384:x1874211952973696:12345-192.168.204.52@tcp:36:rm.0 00010000:00010000:2.0:1787388112.237172:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787388112.237201:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181219f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d99 expref: 37 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237225:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dae expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237267:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18121d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da7 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237282:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d92 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:2.0:1787388112.237298:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388112.237322:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237335:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237343:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237355:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237361:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237367:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237442:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237462:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.237477:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388112.238003:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787388112.238013:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401222333537ns, next at 402222330985ns, rc = 0 00010000:00010000:2.0:1787388112.238065:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238075:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238083:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238090:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238096:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238103:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238125:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388112.238145:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238152:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238158:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238170:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388112.238174:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238182:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238193:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:2.0:1787388112.238196:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787388112.238200:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238205:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181221d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238220:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238226:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238242:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238247:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388112.238250:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238256:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238275:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388112.238277:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388112.238280:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238286:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181220f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388112.238296:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5a72701 reply state 00000000d718a3aa transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238308:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.238314:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:2.0:1787388112.238316:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388112.238319:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388112.238403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+35:11384:x1874211952973696:12345-192.168.204.52@tcp:36:rm.0 Request processed in 1294us (1752us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787388112.238412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 106 00010000:00010000:1.0:1787388112.239169:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388112.239179:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.239188:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388112.239192:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.239201:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.239213:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:1.0:1787388112.239216:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787388112.239219:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.239225:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812224 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.239264:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388112.239266:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388112.239267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388112.324222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.328099:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952973952 00000100:00100000:0.0:1787388112.328114:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952973952 00000100:00100000:0.0:1787388112.328188:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 107 00000100:00100000:0.0:1787388112.328200:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+35:11390:x1874211952973952:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388112.328225:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388112.328255:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181222b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4db5 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.328357:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.328372:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.328382:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.328393:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.328414:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.328420:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388112.330270:0:9533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787388112.330447:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.330463:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.330473:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.330510:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.330518:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333057:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333067:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388112.333073:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333083:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333124:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388112.333128:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388112.333134:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333141:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812232 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388112.333165:0:9533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cd60088 reply state 000000008fcb1bb8 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333179:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.333188:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:0.0:1787388112.333191:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388112.333195:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787388112.334265:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181222b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 38 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.334298:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 37 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.334308:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:0.0:1787388112.334311:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388112.334314:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafba00, rc 0) 00000100:00100000:0.0:1787388112.334430:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+38:11390:x1874211952973952:12345-192.168.204.52@tcp:101:bash.0 Request processed in 6231us (10216us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787388112.334440:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 107 00000100:00100000:2.0:1787388112.342247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.342371:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952974080 00000100:00100000:1.0:1787388112.342387:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952974080 00000100:00100000:1.0:1787388112.342529:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:1.0:1787388112.342542:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211952974080:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:1.0:1787388112.342563:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388112.342587:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dbc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388112.342612:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388112.342632:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1787388112.342637:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388112.342646:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.342664:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.342720:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4800, rc 0) 00000100:00100000:1.0:1787388112.342803:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211952974080:12345-192.168.204.52@tcp:101:bash.0 Request processed in 256us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.342811:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00080000:3.0:1787388112.344665:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388112.347416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.347630:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952974208 00000100:00100000:0.0:1787388112.347641:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952974208 00000100:00100000:0.0:1787388112.348263:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:0.0:1787388112.348277:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+8:11390:x1874211952974208:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388112.348296:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388112.348434:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dc3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.348548:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.348558:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388112.348562:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388112.348567:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.348605:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.348620:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388112.348635:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211971925504:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388112.349372:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388112.353365:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211971925504:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388112.353403:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.353427:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:3.0:1787388112.353502:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+9:11390:x1874211952974208:12345-192.168.204.52@tcp:101:bash.0 Request processed in 5227us (6194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.353530:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:2.0:1787388112.358790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.358954:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952974336 00000100:00100000:3.0:1787388112.358967:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952974336 00010000:00010000:3.0:1787388112.359029:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.359078:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:3.0:1787388112.359090:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+9:2401:x1874211952974336:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388112.359106:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388112.359132:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.359147:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.359175:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056951f1e/0x5cb77467b181224e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dbc expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.359195:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388112.359200:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388112.359209:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.359219:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.359296:0:7461:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.359313:0:7461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7461:1874211971925632:192.168.204.52@tcp:105: 00000100:00100000:3.0:1787388112.359425:0:7461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388112.369876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.371893:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952974592 00000100:00100000:0.0:1787388112.371908:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952974592 00000100:00100000:0.0:1787388112.371992:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:0.0:1787388112.372003:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+38:11390:x1874211952974592:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:0.0:1787388112.372581:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+39:11390:x1874211952974592:12345-192.168.204.52@tcp:35:bash.0 Request processed in 577us (2712us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787388112.372590:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:3.0:1787388112.376015:0:7461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7461:1874211971925632:192.168.204.52@tcp:105: 00010000:00010000:3.0:1787388112.376048:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388112.376128:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211952974336:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 17038us (17351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.376141:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:3.0:1787388112.393090:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388112.393112:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971925760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388112.393178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388112.393244:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971925760 00000100:00100000:3.0:1787388112.393252:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971925760 00000100:00100000:3.0:1787388112.393302:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787388112.393310:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971925760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388112.393333:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388112.393371:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971925760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.393378:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787388112.393405:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388112.393435:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971925760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388112.395243:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971925888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388112.395325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388112.396602:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971925888 00000100:00100000:1.0:1787388112.396628:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971925888 00000100:00100000:1.0:1787388112.396757:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787388112.396769:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971925888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388112.396793:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388112.396863:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971925888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.396870:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787388112.396915:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787388112.396921:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787388112.396947:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971925888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388112.397207:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388112.579940:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.580066:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952974720 00000100:00100000:0.0:1787388112.580076:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952974720 00000100:00100000:0.0:1787388112.580142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 108 00000100:00100000:0.0:1787388112.580154:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+39:11406:x1874211952974720:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388112.580179:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388112.580202:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181225c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dca expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.580287:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.580301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.580312:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388112.580355:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787388112.580359:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388112.580380:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.580405:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181225c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dca expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.580442:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dca expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.580450:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388112.580453:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388112.580456:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa600, rc 0) 00000100:00100000:0.0:1787388112.580521:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+40:11406:x1874211952974720:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 370us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388112.580530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 108 00000100:00100000:2.0:1787388112.588330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.588444:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952974976 00000100:00100000:3.0:1787388112.588455:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952974976 00000100:00100000:3.0:1787388112.588603:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 109 00000100:00100000:3.0:1787388112.588617:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+40:11406:x1874211952974976:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388112.588645:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388112.588667:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181226a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dd1 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.588931:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812271 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.588946:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.588958:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388112.588971:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787388112.589089:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181226a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd1 expref: 43 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.589109:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd1 expref: 42 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.589118:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:3.0:1787388112.589121:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388112.589124:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497600, rc 0) 00000100:00100000:3.0:1787388112.589450:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+42:11406:x1874211952974976:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 835us (1132us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1787388112.589476:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 109 00000100:00100000:2.0:1787388112.594659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.594749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.594772:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952975232 00000100:00100000:1.0:1787388112.594786:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952975232 00000100:00100000:1.0:1787388112.594880:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 110 00000100:00100000:1.0:1787388112.594891:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+42:11406:x1874211952975232:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388112.594921:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388112.594948:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181227f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dd8 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.595141:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952975360 00000100:00100000:3.0:1787388112.595147:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952975360 00000100:00100000:3.0:1787388112.595195:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:3.0:1787388112.595204:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+44:2404:x1874211952975360:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388112.595214:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388112.595248:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812271 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd1 expref: 44 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.595267:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:3.0:1787388112.595273:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388112.595334:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+43:2404:x1874211952975360:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 130us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.595343:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00010000:00010000:1.0:1787388112.595468:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812286 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.595483:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.595493:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388112.595506:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787388112.595626:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181227f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd8 expref: 44 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.595642:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd8 expref: 43 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.595650:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:1.0:1787388112.595654:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787388112.595657:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4c00, rc 0) 00000100:00100000:1.0:1787388112.595791:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+43:11406:x1874211952975232:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 901us (1143us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1787388112.595797:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 110 00000100:00100000:3.0:1787388112.602463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.603540:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952975488 00000100:00100000:1.0:1787388112.603553:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952975488 00000100:00100000:1.0:1787388112.603634:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:1.0:1787388112.603645:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211952975488:12345-192.168.204.52@tcp:1:lfs.0 00010000:00010000:1.0:1787388112.603711:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.603731:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.603740:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388112.603745:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388112.603750:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.603801:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.603832:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 8 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.603849:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211971926016:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388112.603945:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9274019a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388112.606300:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211971926016:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388112.606333:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.607427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.608777:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952975616 00000100:00100000:1.0:1787388112.608800:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952975616 00002000:00100000:1.0:1787388112.608861:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9273c6835f80 x1874211952975616/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:368/0 lens 504/0 e 0 to 0 dl 1787388123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388112.608882:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273c6835f80 with x1874211952975616 ext(0->8) 00010000:00010000:1.0:1787388112.608893:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 9 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.608910:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 9 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388112.608918:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9273c6835f80 00000100:00100000:1.0:1787388112.608960:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:1.0:1787388112.608972:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74df45bd-a066-4da5-9401-b0a043132784+9:2404:x1874211952975616:12345-192.168.204.52@tcp:4:lfs.0 00000100:00100000:1.0:1787388112.612675:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74df45bd-a066-4da5-9401-b0a043132784+11:2404:x1874211952975616:12345-192.168.204.52@tcp:4:lfs.0 Request processed in 3693us (5240us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787388112.612721:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 1 00002000:00100000:1.0:1787388112.615085:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9273c6835f80 x1874211952975616/t4294967303(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:368/0 lens 504/448 e 0 to 0 dl 1787388123 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388112.615099:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273c6835f80 with x1874211952975616 ext(0->8) 00010000:00010000:1.0:1787388112.615109:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 11 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.615125:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 11 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388112.615133:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9273c6835f80 00000100:00100000:3.0:1787388112.621886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000001:00080000:2.0:1787388112.622099:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787388112.622115:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787388112.622319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952975744 00000100:00100000:1.0:1787388112.622330:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952975744 00010000:00010000:1.0:1787388112.622373:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 7 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.622460:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:1.0:1787388112.622475:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211952975744:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388112.622490:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787388112.622508:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787388112.622511:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787388112 00002000:00010000:1.0:1787388112.622513:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787388112 00002000:00010000:1.0:1787388112.622515:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787388112 00002000:00010000:1.0:1787388112.622523:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787388112.622528:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 7 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.622539:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 7 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.622560:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8aee4c/0x5cb77467b1812255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dc3 expref: 7 pid: 8437 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.622574:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388112.622578:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388112.622582:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.622588:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.622670:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388112.622741:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622751:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622771:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622778:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622785:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622791:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388112.622801:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622810:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622827:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.622835:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bc7b1bc/0x5cb77467b1812294 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.622908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952975744:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 437us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.622916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:1.0:1787388112.623547:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952975488:12345-192.168.204.52@tcp:1:lfs.0 Request processed in 19902us (21094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.623556:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:3.0:1787388112.626864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388112.626926:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952976000 00000100:00100000:0.0:1787388112.626946:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952976000 00000100:00100000:0.0:1787388112.627029:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:0.0:1787388112.627038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+43:11406:x1874211952976000:12345-192.168.204.52@tcp:35:lfs.0 00000004:00010000:0.0:1787388112.627100:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd8 expref: 43 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388112.627324:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787388112.627365:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1787388112.627664:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:0.0:1787388112.627733:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.627746:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 47 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.627764:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.627842:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 47 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.627872:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 47 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.627889:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874211971926144:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388112.627985:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8a240 going to sleep for 11 seconds 00000100:00100000:1.0:1787388112.631524:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874211971926144:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388112.631551:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.632774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.632875:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952976128 00000100:00100000:1.0:1787388112.632886:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952976128 00010000:00010000:1.0:1787388112.632926:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 48 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388112.632978:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:1.0:1787388112.632988:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+48:2403:x1874211952976128:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388112.633003:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388112.633011:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 48 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.633025:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 48 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.633049:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4db5 expref: 48 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.633087:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:1.0:1787388112.633093:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.633102:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.633109:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.633141:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388112.633354:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.633363:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388112.633487:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:3.0:1787388112.633602:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787388112.633745:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971926272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787388112.633798:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388112.633827:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388112.633902:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+49:2403:x1874211952976128:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 913us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388112.633911:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:0.0:1787388112.634790:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971926272 00000100:00100000:0.0:1787388112.634803:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971926272 00000100:00100000:0.0:1787388112.634866:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388112.634875:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1874211971926272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787388112.634987:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1874211971926272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388112.634993:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388112.635041:0:6524:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1787388112.635048:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1787388112.635068:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9273d067c380, transno 4294967302 00000100:00100000:0.0:1787388112.635083:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971926272:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787388112.635928:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787388112.636590:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:0.0:1787388112.637149:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971926400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787388112.637526:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388112.637563:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388112.638192:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971926400 00000100:00100000:1.0:1787388112.638201:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971926400 00000100:00100000:1.0:1787388112.638260:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787388112.638271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874211971926400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787388112.638540:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1874211971926400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 270us (1014us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787388112.638550:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388112.638844:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971926400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787388112.638928:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787388112.638989:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.639002:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.639011:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.639018:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388112.639034:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.639045:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.639062:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:3.0:1787388112.639065:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787388112.639072:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.639078:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181229b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388112.639199:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787388112.639275:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787388112.639302:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401623621537ns, next at 402623619738ns, rc = 0 00000001:00080000:3.0:1787388112.639309:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:3.0:1787388112.639333:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273e13c5800) 00010000:00010000:3.0:1787388112.639336:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787388112.639344:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812286 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dd8 expref: 51 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.639443:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+50:11406:x1874211952976000:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 12405us (12589us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787388112.639453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 26 00000020:00080000:3.0:1787388112.639457:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787388112.642618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.642893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952976256 00000100:00100000:2.0:1787388112.642904:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952976256 00000100:00100000:2.0:1787388112.643115:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 111 00000100:00100000:2.0:1787388112.643126:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+50:11406:x1874211952976256:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388112.643162:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388112.643188:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18122a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ddf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.643262:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18122a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ddf expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.643276:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18122a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ddf expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.643295:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388112.643299:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388112.643303:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:2.0:1787388112.643379:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+51:11406:x1874211952976256:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 255us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388112.643386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 111 00000100:00100000:0.0:1787388112.649852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.650255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952976512 00000100:00100000:1.0:1787388112.650266:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952976512 00000100:00100000:1.0:1787388112.650361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:1.0:1787388112.650371:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+51:11406:x1874211952976512:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388112.650627:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+52:11406:x1874211952976512:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 256us (957us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787388112.650649:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:2.0:1787388112.765285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.765377:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952976640 00000100:00100000:3.0:1787388112.765388:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952976640 00000100:00100000:3.0:1787388112.765447:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 112 00000100:00100000:3.0:1787388112.765466:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+52:11416:x1874211952976640:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:3.0:1787388112.766098:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766119:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766131:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766143:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766150:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766175:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766276:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766285:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766292:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388112.766340:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766353:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766359:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766365:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766370:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388112.766374:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766380:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766392:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:3.0:1787388112.766403:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388112.766409:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766415:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18122a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766429:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766434:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766440:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766445:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388112.766447:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766454:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766475:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:3.0:1787388112.766477:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388112.766481:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766487:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18122b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766496:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766508:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766513:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766518:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388112.766520:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.766863:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.767056:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:3.0:1787388112.767059:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388112.767062:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.767068:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18122b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.767242:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+52:11416:x1874211952976640:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 1783us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.767252:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 112 00000100:00100000:2.0:1787388112.824379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.824494:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952976896 00000100:00100000:1.0:1787388112.824506:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952976896 00000100:00100000:1.0:1787388112.824583:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 113 00000100:00100000:1.0:1787388112.824594:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+52:11419:x1874211952976896:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388112.824616:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388112.824639:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18122be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4de6 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825109:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825129:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825139:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825150:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825157:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825163:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825294:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825320:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825326:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388112.825338:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787388112.825422:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825430:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825436:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825443:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388112.825449:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825457:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825468:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388112.825471:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388112.825475:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825481:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b18122c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825495:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825508:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825514:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825520:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388112.825772:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825780:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825789:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:1.0:1787388112.825791:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388112.825794:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825800:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18122cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825846:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18122be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 55 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825861:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 54 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388112.825869:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388112.825871:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388112.825882:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4200, rc 0) 00000100:00100000:1.0:1787388112.826244:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+54:11419:x1874211952976896:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1649us (1872us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787388112.826252:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 113 00000100:00100000:0.0:1787388112.833184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.833265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952977024 00000100:00100000:2.0:1787388112.833274:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952977024 00000100:00100000:2.0:1787388112.833354:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 114 00000100:00100000:2.0:1787388112.833364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+54:11419:x1874211952977024:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:2.0:1787388112.833433:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833474:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833487:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833524:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833538:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833545:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833552:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388112.833556:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833563:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833575:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388112.833578:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388112.833582:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.833588:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388112.833657:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+54:11419:x1874211952977024:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 294us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388112.833670:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 114 00000100:00100000:3.0:1787388112.835987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388112.836139:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952977280 00000100:00100000:1.0:1787388112.836150:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952977280 00000100:00100000:1.0:1787388112.836209:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 28 00000100:00100000:1.0:1787388112.836231:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+54:11419:x1874211952977280:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388112.836461:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+55:11419:x1874211952977280:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 242us (481us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787388112.836470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 28 00000100:00100000:1.0:1787388112.903992:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388112.904022:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971926528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388112.904098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388112.904362:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971926528 00000100:00100000:0.0:1787388112.904373:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971926528 00000100:00100000:0.0:1787388112.904429:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787388112.904440:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971926528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388112.904476:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388112.904569:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971926528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388112.904577:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787388112.906746:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971926528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388112.910482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.910651:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952977536 00000100:00100000:2.0:1787388112.910660:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952977536 00000100:00100000:2.0:1787388112.911052:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 115 00000100:00100000:2.0:1787388112.911064:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+55:11429:x1874211952977536:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:2.0:1787388112.911104:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388112.911107:0:13489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388112.911135:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dca expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.911158:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388112.911163:0:13489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388112.911176:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ded expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.911299:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.911315:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 55 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.911324:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.911357:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 55 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.911371:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 55 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388112.911402:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971926656:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388112.911488:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388112.917468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.917553:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952977664 00000100:00100000:3.0:1787388112.917564:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952977664 00010000:00010000:3.0:1787388112.917615:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 56 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.917658:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 70 00000100:00100000:3.0:1787388112.917668:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+56:2404:x1874211952977664:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388112.917700:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388112.917707:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 56 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.917736:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 56 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.917761:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:3.0:1787388112.917767:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.917777:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.917784:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.917814:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388112.917872:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+56:2404:x1874211952977664:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 205us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.917880:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 70 00010000:00010000:2.0:1787388112.918192:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b18122d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4de6 expref: 55 pid: 9533 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388112.918209:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971926656:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388112.918241:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.918250:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.918256:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388112.918274:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787388112.918402:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18122e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 56 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.918417:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 55 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.918424:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388112.918427:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787388112.918429:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00100000:2.0:1787388112.918466:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+55:11429:x1874211952977536:12345-192.168.204.52@tcp:101:bash.0 Request processed in 7406us (7994us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787388112.918481:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 115 00000100:00100000:1.0:1787388112.924202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.924300:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952977792 00000100:00100000:2.0:1787388112.924311:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952977792 00000100:00100000:0.0:1787388112.924414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 116 00000100:00100000:0.0:1787388112.924426:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+55:11429:x1874211952977792:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388112.924451:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388112.924471:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18122fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.924505:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.924519:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.924531:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.925490:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18122fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.925512:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388112.925520:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:0.0:1787388112.925523:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388112.925526:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:0.0:1787388112.925646:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+56:11429:x1874211952977792:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1221us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388112.925666:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 116 00000100:00100000:3.0:1787388112.930385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.930506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952978048 00000100:00100000:2.0:1787388112.930516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952978048 00000100:00100000:2.0:1787388112.930722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 117 00000100:00100000:2.0:1787388112.930938:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+56:11429:x1874211952978048:12345-192.168.204.52@tcp:36:bash.0 00010000:00010000:2.0:1787388112.931171:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.931189:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.931198:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388112.931250:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1787388112.931268:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c901d4d reply state 000000003deb94e5 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.931517:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.931573:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388112.931577:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388112.931581:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388112.931879:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+59:11429:x1874211952978048:12345-192.168.204.52@tcp:36:bash.0 Request processed in 1145us (1501us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787388112.931887:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 117 00000020:00080000:2.0:1787388112.931893:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388112.935153:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388112.935317:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952978176 00000100:00100000:2.0:1787388112.935326:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952978176 00000100:00100000:2.0:1787388112.935395:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 118 00000100:00100000:2.0:1787388112.935407:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+59:11429:x1874211952978176:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:2.0:1787388112.935429:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388112.935450:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812312 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4dfb expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.935558:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.935584:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 60 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.935594:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.935635:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 60 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.935649:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 60 pid: 13489 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388112.935663:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971926784:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388112.935773:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388112.939777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.940105:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952978304 00000100:00100000:3.0:1787388112.940128:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952978304 00010000:00010000:3.0:1787388112.940164:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 61 pid: 13489 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388112.940210:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:3.0:1787388112.940228:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+61:2403:x1874211952978304:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388112.940243:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388112.940249:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 61 pid: 13489 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.940263:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 61 pid: 13489 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.940285:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:3.0:1787388112.940290:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.940300:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.940307:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388112.940324:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388112.940397:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18122ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ded expref: 61 pid: 13489 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388112.940418:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971926784:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388112.940446:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.940455:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.940461:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388112.940527:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787388112.940532:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388112.940556:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.940870:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812312 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 61 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.940885:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 60 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388112.940892:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388112.940895:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388112.940898:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffc00, rc 0) 00000100:00100000:2.0:1787388112.940960:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+60:11429:x1874211952978176:12345-192.168.204.52@tcp:101:bash.0 Request processed in 5555us (5817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388112.940968:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 118 00000100:00100000:3.0:1787388112.942848:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+59:2403:x1874211952978304:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 2619us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388112.943062:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:1.0:1787388112.944535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388112.945091:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952978560 00000100:00100000:3.0:1787388112.945101:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952978560 00000100:00100000:3.0:1787388112.945196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:3.0:1787388112.945206:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+59:11429:x1874211952978560:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:3.0:1787388112.945441:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+60:11429:x1874211952978560:12345-192.168.204.52@tcp:35:bash.0 Request processed in 236us (914us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787388112.945449:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:2.0:1787388113.006158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388113.006271:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952978688 00000100:00100000:0.0:1787388113.006283:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952978688 00000100:00100000:0.0:1787388113.006369:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 119 00000100:00100000:0.0:1787388113.006380:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+60:11435:x1874211952978688:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388113.006406:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388113.006429:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.006499:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.006513:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.006525:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388113.006570:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787388113.006574:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388113.006591:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.006616:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e02 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.006635:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e02 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.006666:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:0.0:1787388113.006670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388113.006674:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb200, rc 0) 00000100:00100000:0.0:1787388113.006789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+61:11435:x1874211952978688:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 411us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388113.006797:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 119 00000100:00080000:1.0:1787388113.007410:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388113.010420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388113.010618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952978816 00000100:00100000:3.0:1787388113.010631:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952978816 00000100:00100000:3.0:1787388113.010741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 120 00000100:00100000:3.0:1787388113.010752:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+61:11435:x1874211952978816:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388113.010773:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388113.010793:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181232e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011072:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011103:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011115:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011128:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011136:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011144:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011235:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011244:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011250:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388113.011290:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787388113.011295:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388113.011314:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011327:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011346:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011351:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011358:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011369:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.011373:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011380:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.011393:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388113.011396:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.013623:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013647:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812335 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013702:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013710:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013727:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013750:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.013754:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013762:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013778:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:2.0:1787388113.013781:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.013786:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.013792:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181233c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.014025:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181232e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e09 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.014042:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e09 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.014050:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388113.014052:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388113.014054:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152bc00, rc 0) 00000100:00100000:2.0:1787388113.015978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+62:11435:x1874211952978816:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 5216us (5556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388113.015991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 120 00000100:00100000:1.0:1787388113.022757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.022845:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979072 00000100:00100000:2.0:1787388113.022879:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979072 00000100:00100000:2.0:1787388113.022941:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 121 00000100:00100000:2.0:1787388113.022952:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+62:11435:x1874211952979072:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388113.022973:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388113.022996:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181234a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e10 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.023128:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.023155:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 63 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.023164:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e09 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.023173:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388113.023864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388113.024096:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979200 00000100:00100000:0.0:1787388113.024104:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979200 00010000:00010000:0.0:1787388113.024136:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e09 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388113.024167:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:0.0:1787388113.024176:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+64:2402:x1874211952979200:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388113.024187:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388113.024207:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:0.0:1787388113.024212:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.024232:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.024238:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388113.024292:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+64:2402:x1874211952979200:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 118us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388113.024300:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 72 00010000:00010000:2.0:1787388113.024525:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b1812343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e09 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.024556:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 62 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.024570:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 62 pid: 13489 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388113.024586:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3db9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971927040:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388113.024667:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388113.027378:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3db9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971927040:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388113.027409:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388113.027807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.028029:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979328 00000100:00100000:2.0:1787388113.028036:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979328 00010000:00010000:2.0:1787388113.028069:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 63 pid: 13489 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388113.028103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 73 00000100:00100000:2.0:1787388113.028111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+63:2403:x1874211952979328:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388113.028125:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388113.028132:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 63 pid: 13489 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.028144:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 63 pid: 13489 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.028164:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4dfb expref: 63 pid: 13489 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.028179:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388113.028183:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.028193:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.028227:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.028252:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388113.028295:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+62:2403:x1874211952979328:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 184us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388113.028302:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 73 00010000:00010000:1.0:1787388113.028370:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.028379:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388113.028398:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787388113.028524:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181234a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 63 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.028554:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 62 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.028562:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388113.028564:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388113.028567:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c152b800, rc 0) 00000100:00100000:1.0:1787388113.028589:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+62:11435:x1874211952979072:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 5640us (5843us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787388113.028594:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 121 00000100:00100000:3.0:1787388113.031194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388113.031303:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979584 00000100:00100000:0.0:1787388113.031327:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979584 00000100:00100000:0.0:1787388113.031390:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:0.0:1787388113.031401:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+62:11435:x1874211952979584:12345-192.168.204.52@tcp:103:lfs.0 00010000:00010000:0.0:1787388113.031418:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388113.031440:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18122a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ddf expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.031461:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:0.0:1787388113.031466:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388113.031520:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+61:11435:x1874211952979584:12345-192.168.204.52@tcp:103:lfs.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388113.031528:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 8 00010000:00010000:0.0:1787388113.033618:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388113.034194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.034289:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979712 00000100:00100000:2.0:1787388113.034299:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979712 00000100:00100000:2.0:1787388113.034391:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 122 00000100:00100000:2.0:1787388113.034402:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+61:11435:x1874211952979712:12345-192.168.204.52@tcp:58:lfs.0 00010000:00010000:2.0:1787388113.034550:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.034570:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.034582:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388113.034738:0:9533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787388113.034816:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+61:11435:x1874211952979712:12345-192.168.204.52@tcp:58:lfs.0 Request processed in 415us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388113.034825:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 122 00000100:00100000:3.0:1787388113.036589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388113.037155:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979840 00000100:00100000:1.0:1787388113.037167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979840 00000100:00100000:1.0:1787388113.037273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 123 00000100:00100000:1.0:1787388113.037284:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+61:11435:x1874211952979840:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388113.037303:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388113.037324:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e17 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.037383:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.037394:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.037416:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.037430:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.037459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388113.037462:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388113.037467:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388113.037475:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b5c00, rc 0) 00000100:00100000:1.0:1787388113.037544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+62:11435:x1874211952979840:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 262us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388113.037551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 123 00000040:00080000:2.0:1787388113.928404:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388113.928414:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388113.928460:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787388113.928473:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388113.928765:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3db9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971927168:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388113.928936:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388113.936060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388113.936599:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952979968 00000100:00100000:1.0:1787388113.936610:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952979968 00000100:00100000:1.0:1787388113.937076:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 124 00000100:00100000:1.0:1787388113.937090:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952979968:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787388113.937128:0:13489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787388113.937301:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952979968:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 213us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388113.937310:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 124 00000100:00100000:2.0:1787388113.939159:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3db9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971927168:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388113.949339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.949425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952980096 00000100:00100000:2.0:1787388113.949446:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952980096 00000100:00100000:2.0:1787388113.949513:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 125 00000100:00100000:2.0:1787388113.949534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+62:11436:x1874211952980096:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787388113.949617:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.949635:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.949646:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.949664:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950066:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950073:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950109:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950138:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388113.950191:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787388113.950195:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388113.950220:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950232:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950239:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950245:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950250:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152bc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.950254:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950261:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950274:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:2.0:1787388113.950277:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.950282:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950288:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b181236d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950318:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950324:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950330:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950335:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.950337:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950343:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950351:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9273c39fc100) 00010000:00010000:2.0:1787388113.950354:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.950356:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950362:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812374 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950378:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950384:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950391:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950402:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.950405:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950411:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950420:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388113.950422:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.950425:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.950430:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b181237b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388113.953316:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+62:11436:x1874211952980096:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 Request processed in 2911us (3104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388113.953330:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 125 00000100:00100000:0.0:1787388113.955380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.955895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952980352 00000100:00100000:2.0:1787388113.955905:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952980352 00000100:00100000:2.0:1787388113.955967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 126 00000100:00100000:2.0:1787388113.955977:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+62:11436:x1874211952980352:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388113.955996:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388113.956017:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812382 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e1e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956119:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956151:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956163:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388113.956176:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787388113.956271:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956279:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956285:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956291:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.956295:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956302:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956316:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388113.956319:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388113.956323:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956330:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812389 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956372:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812382 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e1e expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956388:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:2.0:1787388113.956391:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388113.956395:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812382 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e1e expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.956405:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff600, rc 0) 00000100:00100000:2.0:1787388113.958065:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952980352:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 2079us (2687us total) trans 4294967400 rc 301/301 00000100:00100000:2.0:1787388113.958077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 126 00000100:00100000:3.0:1787388113.965067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388113.966185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952980480 00000100:00100000:0.0:1787388113.966209:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952980480 00000100:00100000:0.0:1787388113.966278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 127 00000100:00100000:0.0:1787388113.966288:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952980480:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388113.966330:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388113.966588:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952980480:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 300us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388113.966597:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 127 00000100:00100000:3.0:1787388113.977088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.977811:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952980736 00000100:00100000:2.0:1787388113.977822:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952980736 00000100:00100000:2.0:1787388113.977891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:2.0:1787388113.978082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952980736:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388113.978105:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388113.978109:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388113.978139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e02 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.978160:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388113.978165:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388113.978179:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812397 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388113.979513:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787388113.980095:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181239e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.980125:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181239e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.980136:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181239e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.980219:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812397 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e25 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.980240:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181239e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e25 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.980249:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273c39fc100) 00010000:00010000:2.0:1787388113.980252:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388113.980256:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff400, rc 0) 00000100:00100000:2.0:1787388113.980332:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+64:11436:x1874211952980736:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 2431us (3428us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787388113.980341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:1.0:1787388113.985133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388113.985228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952980992 00000100:00100000:2.0:1787388113.985241:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952980992 00000100:00100000:2.0:1787388113.985317:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 129 00000100:00100000:2.0:1787388113.985329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+64:11436:x1874211952980992:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388113.985402:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388113.985431:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181239e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e25 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985452:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273c39fc100) 00010000:00010000:2.0:1787388113.985480:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388113.985503:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985517:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985527:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985540:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985548:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985555:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985604:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985613:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985619:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985625:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.985629:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985637:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985655:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:2.0:1787388113.985658:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.985663:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985719:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18123ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985729:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985735:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985741:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985746:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388113.985749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985755:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985763:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb8821cbe (ffff9273c39fca00) 00010000:00010000:2.0:1787388113.985766:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388113.985769:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388113.985775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb8821cbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388113.985871:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952980992:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 544us (749us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388113.985879:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 129 00000100:00100000:3.0:1787388113.990292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388113.996959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952981120 00000100:00100000:0.0:1787388113.996975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952981120 00000100:00100000:0.0:1787388113.997126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 130 00000100:00100000:0.0:1787388113.997138:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+63:11436:x1874211952981120:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388113.997172:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388113.997196:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18123ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e2c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.997258:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.997277:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.997290:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.997412:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b18123ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.997433:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388113.997442:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388113.997445:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388113.997449:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb600, rc 0) 00000100:00100000:0.0:1787388113.997540:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+64:11436:x1874211952981120:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 404us (7257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388113.997547:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 130 00000100:00100000:1.0:1787388114.004619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.004746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952981376 00000100:00100000:2.0:1787388114.004756:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952981376 00000100:00100000:2.0:1787388114.004816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 131 00000100:00100000:2.0:1787388114.004827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+64:11436:x1874211952981376:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388114.004912:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.004930:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.004941:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388114.005095:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787388114.005105:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402989425200ns, next at 403989422347ns, rc = 0 00000004:00010000:2.0:1787388114.005152:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a112f18d reply state 000000004de84e3d transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.005165:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.005173:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388114.005176:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388114.005179:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388114.005297:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+66:11436:x1874211952981376:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 472us (687us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787388114.005322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 131 00000100:00100000:3.0:1787388114.019011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.019894:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952981504 00000100:00100000:2.0:1787388114.019907:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952981504 00000100:00100000:2.0:1787388114.019976:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 132 00000100:00100000:2.0:1787388114.019986:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+66:11436:x1874211952981504:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388114.020011:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388114.020034:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e33 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.020093:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 67 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.020110:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 67 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.020130:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388114.020134:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388114.020138:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:2.0:1787388114.020215:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+67:11436:x1874211952981504:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 230us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.020224:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 132 00000100:00100000:1.0:1787388114.036098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.036397:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952981632 00000100:00100000:3.0:1787388114.036408:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952981632 00000100:00100000:3.0:1787388114.036509:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 48 00000100:00100000:3.0:1787388114.036536:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211952981632:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787388114.037700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388114.038460:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+9:2401:x1874211952981632:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 1919us (2365us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787388114.038473:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 48 00000100:00100000:3.0:1787388114.043499:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388114.043621:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952981888 00000100:00100000:1.0:1787388114.043631:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952981888 00000100:00100000:1.0:1787388114.044502:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:1.0:1787388114.044522:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+67:11436:x1874211952981888:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388114.045129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+68:11436:x1874211952981888:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 611us (1637us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787388114.045138:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:2.0:1787388114.048896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388114.049794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952982144 00000100:00100000:0.0:1787388114.049805:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952982144 00000100:00100000:0.0:1787388114.049870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 133 00000100:00100000:0.0:1787388114.049880:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+68:11436:x1874211952982144:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787388114.050019:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+68:11436:x1874211952982144:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 141us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.050027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 133 00000100:00100000:3.0:1787388114.053651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.053726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952982272 00000100:00100000:2.0:1787388114.053736:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952982272 00000100:00100000:2.0:1787388114.053795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 134 00000100:00100000:2.0:1787388114.053805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+68:11436:x1874211952982272:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388114.053842:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388114.053862:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18123d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e3a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.054013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18123dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.054029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18123dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.054041:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18123dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388114.054085:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388114.054103:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18123dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.054129:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18123d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e3a expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.054149:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18123dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e3a expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.054158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388114.054161:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787388114.054165:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00100000:2.0:1787388114.054237:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+69:11436:x1874211952982272:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 432us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.054245:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 134 00010000:00010000:2.0:1787388114.056867:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388114.061880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.062222:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952982400 00000100:00100000:3.0:1787388114.062234:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952982400 00000100:00100000:3.0:1787388114.062337:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:3.0:1787388114.062348:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+9:2403:x1874211952982400:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388114.062367:0:10361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388114.062389:0:10361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e41 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388114.062416:0:10361:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960d2, blocks: 0x0 00010000:00010000:3.0:1787388114.062436:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1787388114.062441:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388114.062451:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 10 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.062469:0:10361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 10 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.062482:0:10361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496400, rc 0) 00000100:00100000:3.0:1787388114.062549:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+10:2403:x1874211952982400:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 203us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.062854:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:3.0:1787388114.066839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388114.066940:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952982656 00000100:00100000:1.0:1787388114.066949:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952982656 00000100:00100000:1.0:1787388114.067010:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:1.0:1787388114.067020:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+69:11436:x1874211952982656:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787388114.067209:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+69:11436:x1874211952982656:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 177us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.067218:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:0.0:1787388114.081065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.081282:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952982784 00000100:00100000:3.0:1787388114.081294:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952982784 00000100:00100000:3.0:1787388114.081405:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:3.0:1787388114.081416:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+10:11436:x1874211952982784:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388114.081448:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388114.081468:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e48 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.081510:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.081520:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388114.081524:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388114.081529:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.081564:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.081588:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.081603:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971927296:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388114.081764:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388114.085116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388114.088043:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971927296:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388114.088082:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.088106:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497600, rc 0) 00000100:00100000:0.0:1787388114.088263:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+11:11436:x1874211952982784:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 6848us (7207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.088273:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:2.0:1787388114.089322:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952982912 00000100:00100000:2.0:1787388114.089336:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952982912 00010000:00010000:2.0:1787388114.089378:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.089423:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 74 00000100:00100000:2.0:1787388114.092086:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+11:2404:x1874211952982912:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388114.092112:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388114.092142:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.092163:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.092192:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b18123e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e41 expref: 11 pid: 10361 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.092223:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388114.092228:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388114.092237:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.092248:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.092288:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.092319:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874211971927424:192.168.204.52@tcp:105: 00000100:00100000:2.0:1787388114.092477:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388114.099974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.100091:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874211971927424:192.168.204.52@tcp:105: 00010000:00010000:2.0:1787388114.100114:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388114.100175:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+10:2404:x1874211952982912:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 10743us (15068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.100186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 74 00000100:00100000:0.0:1787388114.101279:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952983040 00000100:00100000:0.0:1787388114.101290:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952983040 00002000:00100000:0.0:1787388114.101345:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9272c3c88700 x1874211952983040/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:370/0 lens 504/0 e 0 to 0 dl 1787388125 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388114.101356:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3c88700 with x1874211952983040 ext(0->12) 00002000:00010000:0.0:1787388114.101362:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3c88700 00000100:00100000:0.0:1787388114.101387:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:0.0:1787388114.101396:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+10:2404:x1874211952983040:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787388114.103194:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+12:2404:x1874211952983040:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 Request processed in 1788us (3220us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787388114.103217:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00002000:00100000:0.0:1787388114.103228:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9272c3c88700 x1874211952983040/t4294967310(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:370/0 lens 504/448 e 0 to 0 dl 1787388125 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388114.103251:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3c88700 with x1874211952983040 ext(0->12) 00002000:00010000:0.0:1787388114.103257:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3c88700 00000100:00100000:3.0:1787388114.106463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.106542:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952983168 00000100:00100000:2.0:1787388114.106554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952983168 00000100:00100000:2.0:1787388114.106628:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:2.0:1787388114.106639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+69:11436:x1874211952983168:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388114.111212:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:3.0:1787388114.111233:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1787388114.111272:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1787388114.111469:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971927552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787388114.111536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.111575:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388114.111582:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971927680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787388114.111605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.111640:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971927552 00000100:00100000:2.0:1787388114.111648:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971927552 00000100:00100000:2.0:1787388114.111731:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971927680 00000100:00100000:2.0:1787388114.111735:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971927680 00000100:00100000:2.0:1787388114.111754:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787388114.111763:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971927552:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787388114.111892:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111904:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111911:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111917:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffe00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388114.111922:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111929:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111947:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9273da1a0800) 00010000:00010000:0.0:1787388114.111951:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388114.111955:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111960:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18120f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111983:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.111990:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112010:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112015:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388114.112018:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112024:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112033:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9273d13bf900) 00010000:00010000:0.0:1787388114.112035:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388114.112038:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112044:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812198 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112062:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112069:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112074:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112079:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fec00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388114.112082:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112098:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112108:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:0.0:1787388114.112110:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388114.112113:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112118:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812216 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112137:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112144:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112148:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112154:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388114.112157:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112163:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112170:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d8f07000) 00010000:00010000:0.0:1787388114.112173:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388114.112175:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112188:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812239 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112216:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112224:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112229:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112233:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388114.112236:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112242:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112251:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:0.0:1787388114.112253:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388114.112256:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112262:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b181230b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112272:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112278:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112291:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112295:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388114.112298:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112303:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112312:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388114.112314:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787388114.112317:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.112323:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18123c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388114.112355:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787388114.112364:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971927680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787388114.112478:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787388114.112482:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787388114 00002000:00010000:0.0:1787388114.112484:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787388114.112486:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787388114 -> 1787388114 00002000:00010000:0.0:1787388114.112489:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787388114.112542:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1874211971927680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (935us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787388114.112549:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00002000:00080000:2.0:1787388114.112748:0:10361:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1787388114.112767:0:10361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.112794:0:10361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 11 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.112803:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1787388114.112817:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388114.112822:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.112854:0:10361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 11 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.112869:0:10361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 11 pid: 10361 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.112882:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10361:1874211971927808:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388114.112949:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efa3b0c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787388114.113185:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c3dbb480/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787388114.113192:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971927680:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787388114.114588:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1787388114.115418:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9272c2f8ad80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787388114.115426:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273fbf77400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9272c2f8a540 00000020:00080000:3.0:1787388114.115429:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273fbf77b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c3d40200 00000004:00080000:3.0:1787388114.115471:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787388114.115504:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9273c8da3540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787388114.115506:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c37f5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9273c8da3c00 00000020:00080000:3.0:1787388114.115509:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c37f5c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c3e71400 00000020:00080000:0.0:1787388114.115779:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787388114.115837:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787388114.115878:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971927936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787388114.116143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.117150:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971927936 00000100:00100000:0.0:1787388114.117161:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971927936 00000100:00100000:0.0:1787388114.117231:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787388114.117240:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971927936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787388114.117267:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1787388114.117298:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8960d0, atime: 0x6a8960d0, ctime: 0x6a8960d0, blocks: 0x8 00010000:00010000:0.0:1787388114.117306:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.117321:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1787388114.117326:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388114.117338:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.117353:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.117364:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.117373:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787388114.117374:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787388114.117391:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388114.117408:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388114.117414:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.117422:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388114.117426:0:10340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.117434:0:10340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.117463:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.117470:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027fa6451/0x5cb77467b18123f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.117490:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388114.117492:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388114.117493:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388114.117536:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1874211971927936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 296us (1393us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787388114.117550:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388114.117601:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+16:11436:x1874211952983168:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 Request processed in 10960us (11144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.117611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 136 00000004:00080000:3.0:1787388114.118356:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c3cae680/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787388114.118366:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971927936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787388114.124376:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10361:1874211971927808:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388114.124407:0:10361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.127193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388114.127248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388114.127324:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952983296 00000100:00100000:0.0:1787388114.127334:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952983296 00010000:00010000:0.0:1787388114.127398:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 12 pid: 10361 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.127404:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952983424 00000100:00100000:2.0:1787388114.127410:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952983424 00000100:00100000:2.0:1787388114.127463:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:2.0:1787388114.127473:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+13:2403:x1874211952983424:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787388114.127643:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 75 00000100:00100000:0.0:1787388114.127651:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+13:2403:x1874211952983296:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388114.127712:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388114.127733:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 13 pid: 10361 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.127748:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 13 pid: 10361 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.127785:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e3d638a/0x5cb77467b18121a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4da0 expref: 13 pid: 10361 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.127920:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388114.127925:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388114.127931:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.127941:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.127985:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388114.128042:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+12:2403:x1874211952983296:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 391us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.128051:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 75 00010000:00010000:3.0:1787388114.132389:0:10361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.132408:0:10361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.132428:0:10361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.132436:0:10361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.132469:0:10361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787388114.132826:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1874211971927552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21049us (21275us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787388114.132865:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1787388114.132950:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388114.132957:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.132967:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388114.132971:0:7471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.132979:0:7471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.132999:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.133006:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b3ce89d/0x5cb77467b18123f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.133026:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388114.133027:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388114.133029:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787388114.133271:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c3dbb100/2, rc 0, transno 4294967312 00000100:00100000:2.0:1787388114.133280:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971927552:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787388114.134124:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787388114.134135:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1787388114.134280:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952983424:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 Request processed in 6801us (7024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.134313:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:1.0:1787388114.138803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.138896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952983680 00000100:00100000:2.0:1787388114.138906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952983680 00000100:00100000:2.0:1787388114.138983:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 137 00000100:00100000:2.0:1787388114.138994:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+16:11436:x1874211952983680:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388114.139046:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388114.139072:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b18123dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e3a expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.139092:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388114.139097:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388114.139128:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.139141:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.139150:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388114.139290:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e584d66f reply state 0000000085d9c612 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.139303:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.139308:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388114.139311:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388114.139313:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388114.139410:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+17:11436:x1874211952983680:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 418us (616us total) trans 4294967404 rc 0/0 00000100:00100000:2.0:1787388114.139418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 137 00000100:00100000:3.0:1787388114.142463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388114.142519:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952983808 00000100:00100000:0.0:1787388114.142529:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952983808 00000100:00100000:0.0:1787388114.142584:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:0.0:1787388114.142595:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952983808:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787388114.142952:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787388114.142956:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787388114 -> 1787388113 00002000:00010000:0.0:1787388114.142958:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787388112 00002000:00010000:0.0:1787388114.142961:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787388114 -> 1787388113 00002000:00010000:0.0:1787388114.142963:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787388114.143031:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952983808:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 437us (576us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787388114.143039:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:1.0:1787388114.146489:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.146652:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984064 00000100:00100000:2.0:1787388114.146662:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984064 00000100:00100000:2.0:1787388114.146806:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 138 00000100:00100000:2.0:1787388114.146817:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+17:11436:x1874211952984064:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787388114.146884:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.146901:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.146909:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.146945:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.146977:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 17 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.146992:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971928064:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388114.147092:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fbffe000 going to sleep for 11 seconds 00000100:00100000:1.0:1787388114.149351:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971928064:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388114.149379:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.150877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.151283:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984192 00000100:00100000:3.0:1787388114.151293:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984192 00010000:00010000:3.0:1787388114.151333:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 18 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.151404:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 76 00000100:00100000:3.0:1787388114.151416:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+18:2404:x1874211952984192:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388114.151431:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388114.151438:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 18 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.151452:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 18 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.151474:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18123c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e2c expref: 18 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.151489:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388114.151495:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.151505:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.151513:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.151558:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388114.151600:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.151609:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.151645:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.151659:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.151675:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+17:2404:x1874211952984192:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 261us (805us total) trans 0 rc 0/0 00010000:00010000:1.0:1787388114.151795:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.151803:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.151808:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.151816:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.151826:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388114.151829:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787388114.151833:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.151838:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 76 00010000:00010000:1.0:1787388114.151839:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812407 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.151878:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+16:11436:x1874211952984064:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 Request processed in 5063us (5397us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787388114.151887:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 138 00000100:00100000:2.0:1787388114.154253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.154324:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984320 00000100:00100000:3.0:1787388114.154334:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984320 00000100:00100000:3.0:1787388114.154390:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:3.0:1787388114.154400:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952984320:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787388114.154445:0:10361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.154465:0:10361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.154474:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388114.154478:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388114.154482:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.154517:0:10361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.154532:0:10361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 7 pid: 8437 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.154547:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10361:1874211971928192:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388114.154649:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388114.157132:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10361:1874211971928192:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388114.157163:0:10361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.158177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388114.158227:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984448 00000100:00100000:1.0:1787388114.158236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984448 00010000:00010000:1.0:1787388114.158279:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 8 pid: 8437 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.158323:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 77 00000100:00100000:1.0:1787388114.158350:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211952984448:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388114.158366:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388114.158389:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 8 pid: 8437 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.158403:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 8 pid: 8437 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.158426:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b18123eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e48 expref: 8 pid: 8437 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.158446:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388114.158451:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388114.158457:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.158467:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.158494:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388114.158549:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952984448:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 201us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.158556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 77 00010000:00010000:3.0:1787388114.158659:0:10361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158673:0:10361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158732:0:10361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158741:0:10361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158750:0:10361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158757:0:10361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388114.158762:0:10361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158770:0:10361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158801:0:10361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.158816:0:10361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181240e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.158860:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952984320:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 Request processed in 4461us (4616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.158868:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:0.0:1787388114.161095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.161215:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984704 00000100:00100000:2.0:1787388114.161224:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984704 00000100:00100000:2.0:1787388114.161314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 139 00000100:00100000:2.0:1787388114.161325:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+16:11436:x1874211952984704:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787388114.161414:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.161431:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.161441:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.161477:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.161491:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 16 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.161526:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971928320:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388114.161616:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fbffe000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388114.164215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388114.164321:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971928320:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388114.164348:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.164402:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984832 00000100:00100000:3.0:1787388114.164409:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984832 00010000:00010000:3.0:1787388114.164441:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 17 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.164477:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 78 00000100:00100000:3.0:1787388114.164487:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+17:2403:x1874211952984832:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388114.164502:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388114.164508:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 17 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164519:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 17 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164540:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4df4 expref: 17 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164584:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:3.0:1787388114.164591:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164600:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164607:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164615:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.164642:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388114.164724:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+16:2403:x1874211952984832:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 237us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.164733:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 78 00010000:00010000:0.0:1787388114.164797:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.164805:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.164972:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.164992:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 16 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.165000:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.165024:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 16 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388114.165036:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 16 pid: 9533 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388114.165048:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971928448:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388114.165093:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2f8af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388114.171191:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971928448:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388114.171237:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.171391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388114.173814:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952984960 00000100:00100000:1.0:1787388114.173829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952984960 00010000:00010000:1.0:1787388114.173877:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 17 pid: 9533 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.174153:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:1.0:1787388114.174165:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+17:2403:x1874211952984960:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388114.174182:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388114.174190:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 17 pid: 9533 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.174213:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 17 pid: 9533 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.174234:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18123cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e33 expref: 17 pid: 9533 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.174253:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388114.174258:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.174267:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.174274:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.174303:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388114.174362:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+16:2403:x1874211952984960:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 199us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.174369:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 79 00010000:00010000:3.0:1787388114.174548:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388114.174557:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388114.174670:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1787388114.175083:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:3.0:1787388114.175120:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1787388114.175212:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971928576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787388114.175269:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388114.175313:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388114.176113:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971928576 00000100:00100000:2.0:1787388114.176123:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971928576 00000100:00100000:2.0:1787388114.176177:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787388114.176185:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971928576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787388114.176291:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971928576:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.176297:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787388114.176538:0:6521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787388114.176544:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c3dbb480, transno 4294967311 00000100:00100000:3.0:1787388114.176995:0:6521:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9272c3dbb100 x1874211971927552/t4294967312(4294967312) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787388130 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388114.177010:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971928576:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787388114.177156:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:3.0:1787388114.177234:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971928704:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787388114.177280:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388114.177312:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388114.177398:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971928704 00000100:00100000:0.0:1787388114.177405:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971928704 00000100:00100000:0.0:1787388114.177449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787388114.177457:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971928704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787388114.177759:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1874211971928704:12345-0@lo:1000:mdt00_001.0 Request processed in 303us (477us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787388114.177768:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787388114.178251:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971928704:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787388114.178297:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178306:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178312:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178318:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.178322:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178330:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178344:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388114.178347:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388114.178351:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178357:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181241c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178379:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178386:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178392:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178405:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.178408:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178414:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178422:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388114.178425:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388114.178432:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178443:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178452:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.178479:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.178491:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971928832:192.168.204.52@tcp:105: 00000100:00100000:1.0:1787388114.178562:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9274019a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388114.181855:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971928832:192.168.204.52@tcp:105: 00010000:00010000:1.0:1787388114.181884:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.181920:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b181235f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.181955:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.181969:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.181979:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.181989:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.181995:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182001:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182008:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.182012:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182018:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182029:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388114.182032:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388114.182035:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182045:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812423 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182055:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182060:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182066:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182071:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fec00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.182074:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182080:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182086:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388114.182088:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388114.182091:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.182096:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812415 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388114.182461:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388114.182466:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388114.183022:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787388114.183031:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388114.183173:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:11436:x1874211952984704:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 21846us (22082us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787388114.183184:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 139 00000020:00080000:1.0:1787388114.183208:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787388114.184948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.185074:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952985088 00000100:00100000:3.0:1787388114.185084:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952985088 00000100:00100000:3.0:1787388114.185139:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:3.0:1787388114.185149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+19:11435:x1874211952985088:12345-192.168.204.52@tcp:49:lfs.0 00000100:00100000:3.0:1787388114.185290:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+19:11435:x1874211952985088:12345-192.168.204.52@tcp:49:lfs.0 Request processed in 142us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.185299:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:0.0:1787388114.191098:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.191446:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952985344 00000100:00100000:3.0:1787388114.191457:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952985344 00000100:00100000:3.0:1787388114.191528:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:3.0:1787388114.191538:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+19:11436:x1874211952985344:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787388114.191852:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787388114.191882:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:2.0:1787388114.192217:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.192236:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.192248:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.192256:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.192277:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.192283:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.192340:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787388114.192439:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+21:11436:x1874211952985344:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 900us (1347us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787388114.192448:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 32 00000020:00080000:2.0:1787388114.192452:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787388114.193736:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388114.193748:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.193758:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fee00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388114.193763:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.193772:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.193788:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388114.193791:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787388114.193796:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.193802:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b181242a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.193820:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388114.193822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388114.193824:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388114.194367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388114.194445:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952985600 00000100:00100000:0.0:1787388114.194454:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952985600 00000100:00100000:0.0:1787388114.194510:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 140 00000100:00100000:0.0:1787388114.194520:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+21:11435:x1874211952985600:12345-192.168.204.52@tcp:58:lfs.0 00000040:00080000:0.0:1787388114.194724:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787388114.194798:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+21:11435:x1874211952985600:12345-192.168.204.52@tcp:58:lfs.0 Request processed in 279us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.194805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 140 00000100:00100000:3.0:1787388114.236501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388114.236720:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952985728 00000100:00100000:1.0:1787388114.236731:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952985728 00000100:00100000:1.0:1787388114.236915:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 141 00000100:00100000:1.0:1787388114.237022:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+21:11438:x1874211952985728:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388114.237047:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388114.237121:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e4f expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237243:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237419:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237432:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237449:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237457:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237463:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237598:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237774:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 22 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237786:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.237941:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 22 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.238034:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 22 pid: 13489 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388114.238047:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971928960:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388114.238300:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9274019a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388114.242594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.242721:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952985984 00000100:00100000:3.0:1787388114.242732:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952985984 00000100:00100000:3.0:1787388114.242808:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:3.0:1787388114.242818:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+23:6171:x1874211952985984:12345-192.168.204.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787388114.242844:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971928960:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388114.242871:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388114.243054:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+24:6171:x1874211952985984:12345-192.168.204.52@tcp:35:ldlm_bl.0 Request processed in 236us (470us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787388114.243066:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:2.0:1787388114.245820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388114.249950:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986112 00000100:00100000:3.0:1787388114.249967:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986112 00010000:00010000:2.0:1787388114.254166:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 24 pid: 13489 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388114.254238:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00100000:2.0:1787388114.254250:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+24:2404:x1874211952986112:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388114.254267:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388114.254274:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 24 pid: 13489 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.254287:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 24 pid: 13489 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.254323:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b1812351 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e10 expref: 24 pid: 13489 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.254346:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388114.254351:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.254361:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.254368:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388114.254406:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388114.254572:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254581:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388114.254638:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787388114.254642:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388114.254661:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254673:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254698:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254705:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254711:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254717:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.254728:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254735:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254745:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388114.254747:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388114.254751:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254757:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254768:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254775:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254781:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254785:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388114.254788:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254794:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254800:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9273d13bfd00) 00010000:00010000:1.0:1787388114.254802:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388114.254809:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254815:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b181243f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254849:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e4f expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254861:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e4f expref: 23 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388114.254868:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388114.254871:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388114.254873:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4200, rc 0) 00000100:00100000:2.0:1787388114.254946:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+23:2404:x1874211952986112:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 698us (9134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.254954:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00100000:1.0:1787388114.258218:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+22:11438:x1874211952985728:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 21266us (21704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.258231:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 141 00000100:00100000:2.0:1787388114.440013:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971929216:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.440096:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.440103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.440144:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929216 00000100:00100000:1.0:1787388114.440155:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929216 00000100:00100000:0.0:1787388114.441393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971929088:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.446009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787388114.446014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.446031:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971929216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446075:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971929600:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.446104:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971929216:12345-0@lo:400:kworker.0 Request processed in 80us (5998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.446118:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787388114.446118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.446142:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971930112:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446165:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.446278:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971930112 00000100:00100000:1.0:1787388114.446285:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971930112 00000100:00100000:0.0:1787388114.446315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929088 00000100:00100000:0.0:1787388114.446321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929088 00000100:00100000:1.0:1787388114.446346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787388114.446356:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971930112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787388114.446373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971929088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.446407:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971930112:12345-0@lo:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.446416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787388114.446421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971929088:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.446429:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1787388114.446442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388114.446468:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929600 00000100:00100000:0.0:1787388114.446472:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929600 00000100:00100000:0.0:1787388114.446500:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787388114.446507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.446511:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971929600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.446538:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971929984:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446553:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971929600:12345-0@lo:400:kworker.0 Request processed in 45us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.446568:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787388114.446574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.446591:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929472 00000100:00100000:0.0:1787388114.446596:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929472 00000100:00100000:1.0:1787388114.446601:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388114.446617:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929984 00000100:00100000:0.0:1787388114.446620:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929984 00000100:00100000:0.0:1787388114.446636:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787388114.446642:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971929472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446672:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874211971929472:12345-0@lo:400:kworker.0 Request processed in 30us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.446696:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787388114.446708:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787388114.446714:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971929984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446742:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971929984:12345-0@lo:400:kworker.0 Request processed in 28us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.446747:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787388114.446790:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388114.446818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.446848:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971929088:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446861:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971929600:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446869:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971930112:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.446896:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971930624 00000100:00100000:0.0:1787388114.446900:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971930624 00000100:00100000:0.0:1787388114.446927:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787388114.446934:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971930624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388114.446964:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787388114.447001:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971930624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.447007:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787388114.447037:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971930624:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787388114.447061:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388114.447065:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388114.447366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.447401:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874211971929472:0@lo:400:kworker.0 00010000:00080000:1.0:1787388114.447415:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5d5aa00 x1874211971929984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388114.447427:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971929984:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.447459:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971930496 00000100:00100000:1.0:1787388114.447464:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971930496 00000100:00100000:1.0:1787388114.447491:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787388114.447498:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874211971930496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388114.447511:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388114.447636:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874211971930496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.447644:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787388114.447692:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388114.450209:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971929216:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450225:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971929728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.450310:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971930240:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450335:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.450381:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787388114.450388:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971929344:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.450442:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971929856:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.450477:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c36b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971930368:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.450563:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929344 00000100:00100000:2.0:1787388114.450569:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929344 00000100:00100000:2.0:1787388114.450611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388114.450619:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971929344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450665:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971929344:12345-0@lo:400:kworker.0 Request processed in 46us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.450671:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388114.450718:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929728 00000100:00100000:2.0:1787388114.450722:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929728 00000100:00100000:2.0:1787388114.450752:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971930368 00000100:00100000:2.0:1787388114.450755:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971930368 00000100:00100000:2.0:1787388114.450775:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388114.450781:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971929728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450812:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971929728:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.450818:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388114.450830:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787388114.450835:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971930368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.450861:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971930368:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.450867:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787388114.450887:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388114.450895:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971930752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388114.450922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.450954:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971930240 00000100:00100000:2.0:1787388114.450958:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971930240 00000100:00100000:2.0:1787388114.450984:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971929856 00000100:00100000:2.0:1787388114.450987:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971929856 00000100:00100000:2.0:1787388114.451006:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787388114.451012:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971930240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.451042:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971930240:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.451048:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787388114.451059:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787388114.451065:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971929856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.451090:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971929856:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.451096:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1787388114.451112:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388114.451116:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388114.451119:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388114.451127:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971930752 00000100:00100000:2.0:1787388114.451129:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971930752 00000100:00100000:2.0:1787388114.451149:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787388114.451155:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971930752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388114.451177:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787388114.451223:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971930752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.451229:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787388114.451270:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971930752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388114.451296:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971929344:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.451305:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971929856:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.451313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c36b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971930368:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.451323:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971929728:0@lo:400:kworker.0 00010000:00080000:2.0:1787388114.451334:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273eecbf100 x1874211971930240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388114.451343:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971930240:0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.773608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.774703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.774743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.774789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986752 00000100:00100000:2.0:1787388114.774799:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986752 00000100:00100000:2.0:1787388114.774860:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 290 00000100:00100000:2.0:1787388114.774871:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952986752:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388114.774944:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2402:x1874211952986752:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.774952:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 290 00000100:00080000:2.0:1787388114.774973:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388114.775221:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986496 00000100:00100000:3.0:1787388114.775227:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986496 00000100:00100000:3.0:1787388114.775264:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 117 00000100:00100000:3.0:1787388114.775272:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952986496:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388114.775309:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2402:x1874211952986496:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.775317:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 117 00000100:00100000:0.0:1787388114.782051:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986240 00000100:00100000:0.0:1787388114.782064:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986240 00000100:00100000:0.0:1787388114.782127:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 382 00000100:00100000:0.0:1787388114.782137:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2402:x1874211952986240:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388114.782230:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2402:x1874211952986240:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 93us (8631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.782239:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 382 00000100:00100000:2.0:1787388114.782750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.782876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.782905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388114.782927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986368 00000100:00100000:2.0:1787388114.782931:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986368 00000100:00100000:2.0:1787388114.782980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986880 00000100:00100000:2.0:1787388114.782983:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986880 00000100:00100000:2.0:1787388114.783003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 291 00000100:00100000:2.0:1787388114.783011:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952986368:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388114.783057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952986368:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.783064:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 291 00000100:00100000:2.0:1787388114.783077:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 292 00000100:00100000:2.0:1787388114.783083:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952986880:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388114.783107:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211952986880:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.783113:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 292 00000100:00080000:2.0:1787388114.783132:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388114.784039:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952986624 00000100:00100000:3.0:1787388114.784049:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952986624 00000100:00100000:3.0:1787388114.784206:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 118 00000100:00100000:3.0:1787388114.784217:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952986624:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388114.784268:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211952986624:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 53us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.784285:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 118 00000100:00080000:2.0:1787388114.784515:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787388115.032596:0:14316:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388115.032611:0:14316:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388115.032653:0:14316:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787388115.032661:0:14316:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787388115.081365:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388115.207932:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388115.207942:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388115.207972:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787388115.207983:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388115.208138:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971930880:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388115.208333:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6ab8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787388115.215258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388115.215978:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273d067ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971930880:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388115.216944:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952987008 00000100:00100000:0.0:1787388115.216957:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952987008 00000100:00100000:0.0:1787388115.217064:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 142 00000100:00100000:0.0:1787388115.217076:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+22:11451:x1874211952987008:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388115.217116:0:13489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1787388115.217320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388115.217994:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+22:11451:x1874211952987008:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 915us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388115.218006:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 142 00000100:00100000:3.0:1787388115.226007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388115.226233:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952987264 00000100:00100000:2.0:1787388115.226244:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952987264 00000100:00100000:2.0:1787388115.226313:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 143 00000100:00100000:2.0:1787388115.226324:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+22:11451:x1874211952987264:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388115.226361:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388115.226383:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b181244d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e56 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388115.226506:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1812454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388115.226521:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1812454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388115.226532:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1812454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388115.226544:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787388115.226674:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b181244d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e56 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388115.226731:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1812454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e56 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388115.226740:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388115.226744:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388115.226747:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffe00, rc 0) 00000100:00100000:2.0:1787388115.226814:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+24:11451:x1874211952987264:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 492us (817us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787388115.226822:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 143 00000100:00100000:2.0:1787388115.235222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388115.235322:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952987392 00000100:00100000:1.0:1787388115.235335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952987392 00000100:00100000:1.0:1787388115.235410:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:1.0:1787388115.235430:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+24:2404:x1874211952987392:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388115.235448:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787388115.235465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00010000:00010000:1.0:1787388115.235475:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b1812454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e56 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388115.235496:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388115.235502:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388115.235559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952987648 00000100:00100000:3.0:1787388115.235566:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952987648 00000100:00100000:1.0:1787388115.235567:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+23:2404:x1874211952987392:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388115.235578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:3.0:1787388115.235604:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 144 00000100:00100000:3.0:1787388115.235629:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+23:11451:x1874211952987648:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787388115.235735:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235749:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235762:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235930:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235940:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235947:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235954:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388115.235959:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235968:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235980:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:3.0:1787388115.235983:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388115.235987:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388115.235993:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812462 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388115.236096:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+24:11451:x1874211952987648:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 466us (628us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787388115.236104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 144 00000040:00080000:2.0:1787388115.236267:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388115.236278:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388115.236961:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787388115.236972:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388115.242866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388115.243117:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952987904 00000100:00100000:3.0:1787388115.243126:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952987904 00000100:00100000:3.0:1787388115.243284:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 34 00000100:00100000:3.0:1787388115.243297:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+24:11451:x1874211952987904:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787388115.243552:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+25:11451:x1874211952987904:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 258us (697us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787388115.243561:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 34 00010000:00010000:2.0:1787388116.104267:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388116.962845:0:14367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388116.962855:0:14367:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388116.962888:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787388116.962896:0:14367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388117.095506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388117.095590:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988160 00000100:00100000:2.0:1787388117.095601:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988160 00000100:00100000:2.0:1787388117.095706:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:2.0:1787388117.095718:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+25:11471:x1874211952988160:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388117.095754:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388117.095778:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812469 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e5d expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388117.096130:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1812470 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388117.096157:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1812470 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388117.096170:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1812470 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388117.096181:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787388117.096358:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812469 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e5d expref: 28 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388117.096378:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1812470 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e5d expref: 27 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388117.096388:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:2.0:1787388117.096402:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787388117.096406:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00080000:1.0:1787388117.096530:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388117.096564:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+27:11471:x1874211952988160:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 849us (1069us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787388117.096572:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:2.0:1787388117.103070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388117.103194:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988288 00000100:00100000:3.0:1787388117.103282:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988288 00000100:00100000:3.0:1787388117.103346:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00100000:3.0:1787388117.103358:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+27:11471:x1874211952988288:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:3.0:1787388117.103432:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103452:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103464:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103500:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103507:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103526:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103532:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388117.103537:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103544:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103557:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:3.0:1787388117.103560:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388117.103564:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.103571:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497800/0x5cb77467b181247e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388117.105248:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+27:11471:x1874211952988288:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 1883us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388117.105262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 146 00010000:00010000:0.0:1787388117.129281:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388117.202875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388117.203097:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988416 00000100:00100000:3.0:1787388117.203106:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988416 00000100:00100000:3.0:1787388117.203180:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:3.0:1787388117.203189:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2401:x1874211952988416:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:3.0:1787388117.203503:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388117.203528:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032ecc051/0x5cb77467b1812485 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e64 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388117.203569:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8960d1, atime: 0x6a8960d0, ctime: 0x6a8960d1, blocks: 0x8 00010000:00010000:3.0:1787388117.203589:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1787388117.203593:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388117.203602:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ecc051/0x5cb77467b1812485 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e64 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.203620:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032ecc051/0x5cb77467b1812485 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e64 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.203632:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497800, rc 0) 00000100:00100000:3.0:1787388117.203883:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211952988416:12345-192.168.204.52@tcp:101:cat.0 Request processed in 694us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388117.203891:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00080000:2.0:1787388117.204001:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388117.208495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388117.210333:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988544 00000100:00100000:2.0:1787388117.210351:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988544 00002000:00100000:2.0:1787388117.210411:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9273ff9c5180 x1874211952988544/t0(0) o3->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:373/0 lens 488/0 e 0 to 0 dl 1787388128 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787388117.210424:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273ff9c5180 with x1874211952988544 ext(0->4095) 00002000:00010000:2.0:1787388117.210430:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9273ff9c5180 00000100:00100000:2.0:1787388117.210640:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:2.0:1787388117.210651:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211952988544:12345-192.168.204.52@tcp:3:cat.0 00000100:00100000:2.0:1787388117.210874:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211952988544:12345-192.168.204.52@tcp:3:cat.0 Request processed in 225us (2389us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787388117.210882:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00002000:00100000:2.0:1787388117.210890:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9273ff9c5180 x1874211952988544/t0(0) o3->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:373/0 lens 488/4536 e 0 to 0 dl 1787388128 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787388117.210909:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273ff9c5180 with x1874211952988544 ext(0->4095) 00002000:00010000:2.0:1787388117.210914:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9273ff9c5180 00000100:00100000:2.0:1787388117.512289:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971931008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388117.512374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388117.512673:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931008 00000100:00100000:0.0:1787388117.512704:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931008 00000100:00100000:0.0:1787388117.512774:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787388117.512796:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874211971931008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388117.512826:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787388117.512876:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874211971931008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388117.512884:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1787388117.513478:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388117.513525:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971931008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388117.513727:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971931136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388117.513775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388117.513859:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931136 00000100:00100000:1.0:1787388117.513865:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931136 00000100:00100000:1.0:1787388117.513915:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787388117.513923:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971931136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388117.513939:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388117.513987:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971931136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388117.513994:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787388117.514047:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388117.514310:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971931136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388118.024758:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388118.024781:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971931264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388118.024863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388118.024929:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931264 00000100:00100000:0.0:1787388118.024937:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931264 00000100:00100000:0.0:1787388118.024980:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787388118.024988:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971931264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388118.025022:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388118.025075:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971931264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388118.025081:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787388118.025136:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971931264:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1787388118.033572:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1787388118.152274:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388118.343865:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388118.343876:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388118.343911:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787388118.343919:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787388118.728392:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388119.176094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388119.559878:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388119.559903:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971931392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388119.559972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.560299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971931776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.560333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.560353:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971932288:0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.560376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.560396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787388119.560402:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971931648:0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.560426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.560443:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971932160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.560463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.560492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931776 00000100:00100000:1.0:1787388119.560500:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931776 00000100:00100000:1.0:1787388119.560865:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787388119.560874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971931776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.560928:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971931776:12345-0@lo:400:kworker.0 Request processed in 55us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.560934:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787388119.560957:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932288 00000100:00100000:1.0:1787388119.560961:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932288 00000100:00100000:1.0:1787388119.560991:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932160 00000100:00100000:1.0:1787388119.560994:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932160 00000100:00100000:1.0:1787388119.561026:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388119.561031:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971932288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.561063:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971932288:12345-0@lo:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.561069:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388119.561080:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787388119.561086:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971932160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.561124:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971932160:12345-0@lo:400:kworker.0 Request processed in 38us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.561130:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787388119.561147:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931648 00000100:00100000:1.0:1787388119.561150:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931648 00000100:00100000:1.0:1787388119.561173:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787388119.561179:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971931648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561346:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971931904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561402:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971932544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388119.561423:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561438:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971932928:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561479:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787388119.561485:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971931520:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561697:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971932032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561740:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971932416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561777:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971933056:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561821:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971932672:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561855:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388119.561868:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971932800:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.561892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.561911:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931904 00000100:00100000:2.0:1787388119.561915:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931904 00000100:00100000:3.0:1787388119.562003:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931392 00000100:00100000:3.0:1787388119.562008:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931392 00000100:00100000:3.0:1787388119.562040:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787388119.562047:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971931392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388119.562070:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388119.562120:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971931392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.562133:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787388119.562314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932928 00000100:00100000:3.0:1787388119.562318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932928 00000100:00100000:1.0:1787388119.565751:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971931648:12345-0@lo:400:kworker.0 Request processed in 4562us (5314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.565768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787388119.565853:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932416 00000100:00100000:2.0:1787388119.565860:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932416 00000100:00100000:3.0:1787388119.574547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932672 00000100:00100000:3.0:1787388119.574580:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932672 00000100:00100000:3.0:1787388119.574625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932800 00000100:00100000:3.0:1787388119.574628:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932800 00000100:00100000:3.0:1787388119.574651:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787388119.574662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971931904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.574799:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971931904:12345-0@lo:400:kworker.0 Request processed in 138us (13422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.574807:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787388119.574824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787388119.574830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971932928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.575112:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971932928:12345-0@lo:400:kworker.0 Request processed in 281us (13652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.575120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787388119.575137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787388119.575144:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971932672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.575184:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971932672:12345-0@lo:400:kworker.0 Request processed in 40us (13339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.575190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787388119.575201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787388119.575207:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971932800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.575234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971932800:12345-0@lo:400:kworker.0 Request processed in 27us (13341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.575251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787388119.575283:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932544 00000100:00100000:3.0:1787388119.575287:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932544 00000100:00100000:3.0:1787388119.575305:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971932032 00000100:00100000:3.0:1787388119.575308:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971932032 00000100:00100000:3.0:1787388119.575319:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787388119.575325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971932544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388119.575354:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787388119.575389:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971932544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (13965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.575395:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787388119.575407:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787388119.575412:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971932032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.575439:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971932032:12345-0@lo:400:kworker.0 Request processed in 27us (13716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.575444:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787388119.575938:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933056 00000100:00100000:3.0:1787388119.575944:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933056 00000100:00100000:3.0:1787388119.575969:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787388119.575975:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971933056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.576011:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971933056:12345-0@lo:400:kworker.0 Request processed in 36us (14214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.576017:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787388119.577849:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388119.577859:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388119.577863:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388119.577865:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388119.577924:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787388119.577934:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1787388119.577959:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c3cae680, transno 4294967305 00000100:00100000:0.0:1787388119.577989:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971931392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388119.578048:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971931648:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.578061:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971932160:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.578071:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971931776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.578085:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971932288:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.578176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971931520 00000100:00100000:0.0:1787388119.578181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971931520 00000100:00100000:0.0:1787388119.578232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787388119.578242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971931520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.578313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971931520:12345-0@lo:400:kworker.0 Request processed in 72us (16801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.578320:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787388119.578364:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388119.580466:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787388119.580485:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971932416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580564:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971932416:12345-0@lo:400:kworker.0 Request processed in 87us (18801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.580572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787388119.580623:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971932800:0@lo:400:kworker.0 00010000:00080000:2.0:1787388119.580640:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6837b80 x1874211971932672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388119.580652:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971932672:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580706:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971931520:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580719:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971932032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580729:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971932416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580741:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971933056:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580753:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971931904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.580768:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971932544:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787388119.580780:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6837800 x1874211971932928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388119.580805:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971932928:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.582715:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971933184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388119.582782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388119.582828:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933184 00000100:00100000:2.0:1787388119.582837:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933184 00000100:00100000:2.0:1787388119.582889:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787388119.582898:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971933184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388119.582929:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388119.583112:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971933184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.583120:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787388119.583149:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971933184:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1787388119.588788:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1787388119.588822:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9272c367fb40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787388119.588827:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9274019a7f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9272c367fa80 00000020:00080000:1.0:1787388119.588831:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273eeec3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9273fbc96e00 00000020:00080000:1.0:1787388119.588858:0:6499:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1787388119.588926:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.588940:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.588948:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.588954:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388119.588959:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.588982:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.589000:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388119.589003:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388119.589008:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.589015:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812400 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787388119.589107:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787388119.589187:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787388119.899162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388119.899301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388119.899351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388119.899382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388119.899411:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988928 00000100:00100000:0.0:1787388119.899422:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988928 00000100:00100000:0.0:1787388119.899493:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989440 00000100:00100000:0.0:1787388119.899496:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989440 00000100:00100000:0.0:1787388119.899521:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 299 00000100:00100000:0.0:1787388119.899530:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952988928:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388119.899605:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952988928:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.899614:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 299 00000100:00100000:0.0:1787388119.899634:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 300 00000100:00100000:0.0:1787388119.899643:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952989440:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388119.899674:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952989440:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.899714:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 300 00000100:00080000:0.0:1787388119.899744:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388119.900557:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989184 00000100:00100000:2.0:1787388119.900566:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989184 00000100:00100000:2.0:1787388119.900628:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 122 00000100:00100000:2.0:1787388119.900638:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952989184:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388119.900718:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952989184:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 81us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.900725:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 122 00000100:00080000:1.0:1787388119.900990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388119.901911:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988672 00000100:00100000:3.0:1787388119.901921:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988672 00000100:00100000:2.0:1787388119.902588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 384 00000100:00100000:2.0:1787388119.902599:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952988672:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388119.902662:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211952988672:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 64us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.902671:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 384 00000100:00100000:2.0:1787388119.902762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388119.902825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388119.902851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388119.902872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952988800 00000100:00100000:2.0:1787388119.902876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952988800 00000100:00100000:2.0:1787388119.902932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989312 00000100:00100000:2.0:1787388119.902936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989312 00000100:00100000:2.0:1787388119.902965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 301 00000100:00100000:2.0:1787388119.902972:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+13:2403:x1874211952988800:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388119.903016:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+13:2403:x1874211952988800:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.903023:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 301 00000100:00100000:2.0:1787388119.903037:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 302 00000100:00100000:2.0:1787388119.903043:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952989312:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388119.903068:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211952989312:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.903074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 302 00000100:00100000:2.0:1787388119.903106:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989056 00000100:00100000:2.0:1787388119.903110:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989056 00000100:00100000:2.0:1787388119.903152:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 123 00000100:00100000:2.0:1787388119.903160:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952989056:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388119.903187:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211952989056:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.903194:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 123 00000100:00080000:2.0:1787388119.903218:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388119.903221:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787388120.092812:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1787388120.092836:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:1.0:1787388120.201056:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388121.223964:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388121.896125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388121.896196:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989568 00000100:00100000:3.0:1787388121.896208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989568 00000100:00100000:3.0:1787388121.896303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 147 00000100:00100000:3.0:1787388121.896315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+13:11116:x1874211952989568:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787388121.896382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388121.896431:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+13:11116:x1874211952989568:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388121.896440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 147 00000100:00100000:1.0:1787388121.913324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388121.913407:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989696 00000100:00100000:2.0:1787388121.913418:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989696 00000100:00100000:2.0:1787388121.913495:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 148 00000100:00100000:2.0:1787388121.913507:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:11116:x1874211952989696:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787388121.913638:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:11116:x1874211952989696:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 Request processed in 135us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388121.913646:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 148 00000100:00080000:1.0:1787388121.913764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388121.925430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388121.925797:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952989952 00000100:00100000:1.0:1787388121.925808:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952989952 00000100:00100000:1.0:1787388121.925944:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:1.0:1787388121.925958:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+13:11116:x1874211952989952:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388121.926551:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+14:11116:x1874211952989952:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 595us (1131us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787388121.926562:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:3.0:1787388122.122848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388122.122931:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990080 00000100:00100000:2.0:1787388122.122942:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990080 00000100:00100000:2.0:1787388122.123019:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 149 00000100:00100000:2.0:1787388122.123031:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:11930:x1874211952990080:12345-192.168.204.52@tcp:101:lsof.0 00010000:00010000:2.0:1787388122.123063:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388122.123085:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b181248c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e6b expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.123150:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.123164:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.123177:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388122.123225:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388122.123254:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388122.123319:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.123346:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b181248c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 7 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.123366:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 6 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.123376:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388122.123379:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388122.123384:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fec00, rc 0) 00000100:00100000:2.0:1787388122.123454:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:11930:x1874211952990080:12345-192.168.204.52@tcp:101:lsof.0 Request processed in 426us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.123461:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 149 00000100:00080000:1.0:1787388122.124069:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787388122.248177:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388122.632063:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971933312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388122.632158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388122.632444:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933312 00000100:00100000:1.0:1787388122.632453:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933312 00000100:00100000:1.0:1787388122.632518:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787388122.632529:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971933312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388122.632559:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388122.632605:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971933312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.632613:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1787388122.632673:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388122.632895:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:0.0:1787388122.632901:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c3dbb100, transno 4294967312 00000004:00080000:0.0:1787388122.632918:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:0.0:1787388122.632946:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971933312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388122.639057:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971933440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388122.639123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388122.639482:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933440 00000100:00100000:0.0:1787388122.639491:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933440 00000100:00100000:0.0:1787388122.639552:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787388122.639560:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971933440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388122.639582:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787388122.639635:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971933440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388122.639642:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787388122.639728:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971933440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787388122.639836:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388123.144770:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971933568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388123.144916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388123.146157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933568 00000100:00100000:3.0:1787388123.146169:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933568 00000100:00100000:3.0:1787388123.146219:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787388123.146229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971933568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388123.146470:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388123.147413:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971933568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1179us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388123.147425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787388123.152670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971933568:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388123.272110:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388124.298663:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388124.679881:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971933952:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.680002:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971934080:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.680020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.680108:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971933824:0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.680108:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971934208:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.685112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.685226:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971934592:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.685290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.685316:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971935104:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.685342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.685378:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971935616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388124.685417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.685468:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934592 00000100:00100000:2.0:1787388124.685478:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934592 00000100:00100000:2.0:1787388124.685538:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787388124.685549:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971934592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.685606:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971934592:12345-0@lo:400:kworker.0 Request processed in 59us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.685614:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787388124.685643:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934080 00000100:00100000:2.0:1787388124.685646:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934080 00000100:00100000:2.0:1787388124.685716:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935616 00000100:00100000:2.0:1787388124.685720:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935616 00000100:00100000:2.0:1787388124.685737:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787388124.685744:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971934080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.685782:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971934080:12345-0@lo:400:kworker.0 Request processed in 38us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.685788:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787388124.685801:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787388124.685807:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971935616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388124.685835:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787388124.685867:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971935616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.685873:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1787388124.685888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388124.685900:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933952 00000100:00100000:2.0:1787388124.685905:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933952 00000100:00100000:2.0:1787388124.685930:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935104 00000100:00100000:2.0:1787388124.685944:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935104 00000100:00100000:2.0:1787388124.685975:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787388124.685981:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971933952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.686024:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971933952:12345-0@lo:400:kworker.0 Request processed in 44us (6005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.686031:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787388124.686042:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787388124.686048:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971935104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.686073:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971935104:12345-0@lo:400:kworker.0 Request processed in 25us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.686079:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:2.0:1787388124.686094:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388124.686133:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971935616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388124.686145:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971934080:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.686155:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971934592:0@lo:400:kworker.0 00010000:00080000:2.0:1787388124.686167:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c4488380 x1874211971935104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388124.686178:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971935104:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.690373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.690421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971933696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388124.690883:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933824 00000100:00100000:2.0:1787388124.690893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933824 00000100:00100000:2.0:1787388124.690950:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1787388124.690960:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971933824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.690972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.691025:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971933824:12345-0@lo:400:kworker.0 Request processed in 66us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.691042:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787388124.691148:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971933952:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.691178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971934464:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.691210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.691251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.691278:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971934720:0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.691303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.691321:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971935232:0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.691357:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934208 00000100:00100000:1.0:1787388124.691360:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934208 00000100:00100000:1.0:1787388124.691388:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934720 00000100:00100000:1.0:1787388124.691390:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934720 00000100:00100000:1.0:1787388124.691418:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787388124.691423:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971934208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.691456:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971934208:12345-0@lo:400:kworker.0 Request processed in 33us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.691460:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787388124.691472:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787388124.691478:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971934720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.691504:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874211971934720:12345-0@lo:400:kworker.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.691509:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1787388124.691527:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388124.691621:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971933696 00000100:00100000:1.0:1787388124.691626:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971933696 00000100:00100000:3.0:1787388124.691663:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971934336:0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.691666:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787388124.691673:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971933696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388124.691708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787388124.691721:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388124.691728:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971934848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.691747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.691751:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971933696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.691758:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787388124.691763:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971935360:0@lo:400:kworker.0 00000100:00080000:1.0:1787388124.691772:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388124.691801:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934336 00000100:00100000:3.0:1787388124.691804:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934336 00000100:00100000:3.0:1787388124.691844:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787388124.691851:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971934336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.691888:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971934336:12345-0@lo:400:kworker.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.691894:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787388124.691912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934848 00000100:00100000:3.0:1787388124.691915:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934848 00000100:00100000:3.0:1787388124.691943:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787388124.691948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971934848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.692160:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971934976:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.692194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388124.692209:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971935488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388124.692329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934976 00000100:00100000:1.0:1787388124.692334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934976 00000100:00100000:1.0:1787388124.692362:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787388124.692368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971934976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.692406:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971934976:12345-0@lo:400:kworker.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.692412:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1787388124.692429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388124.692432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388124.692457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388124.692495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388124.692539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971934976:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.692562:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935488 00000100:00100000:0.0:1787388124.692565:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935488 00000100:00100000:3.0:1787388124.692668:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971934848:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.692675:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787388124.692807:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787388124.692816:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971935488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388124.692828:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388124.692861:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971935488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.692867:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787388124.692882:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388124.692944:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971934464 00000100:00100000:2.0:1787388124.692949:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971934464 00000100:00100000:2.0:1787388124.693054:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787388124.693061:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971934464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.693108:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971934464:12345-0@lo:400:kworker.0 Request processed in 47us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.693115:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787388124.693213:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971934464:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.693243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971935488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388124.693453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971934208:0@lo:400:kworker.0 00000100:00100000:1.0:1787388124.693465:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874211971934720:0@lo:400:kworker.0 00000100:00080000:0.0:1787388124.694911:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388124.696135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.697321:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971933824:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.697353:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971933696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388124.697366:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971934336:0@lo:400:kworker.0 00010000:00080000:3.0:1787388124.697380:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c4488e00 x1874211971934848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388124.697391:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971934848:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.701373:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935232 00000100:00100000:2.0:1787388124.701388:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935232 00000100:00100000:2.0:1787388124.701461:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935360 00000100:00100000:2.0:1787388124.701464:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935360 00000100:00100000:2.0:1787388124.703807:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787388124.703832:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971935232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.703939:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971935232:12345-0@lo:400:kworker.0 Request processed in 118us (11480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.703948:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787388124.703970:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787388124.704003:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971935360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.704043:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971935360:12345-0@lo:400:kworker.0 Request processed in 66us (7913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.704049:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787388124.708860:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971935360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.708932:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971935232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388125.016527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016600:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016644:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388125.016737:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990720 00000100:00100000:3.0:1787388125.016746:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990720 00000100:00100000:3.0:1787388125.016807:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990592 00000100:00100000:3.0:1787388125.016810:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990592 00000100:00100000:3.0:1787388125.016836:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:3.0:1787388125.016846:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952990720:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388125.016919:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952990720:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.016928:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:3.0:1787388125.016945:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 129 00000100:00100000:3.0:1787388125.016952:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952990592:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388125.016976:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952990592:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.016995:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 129 00000100:00100000:3.0:1787388125.017014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990464 00000100:00100000:3.0:1787388125.017017:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990464 00000100:00100000:3.0:1787388125.017061:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990976 00000100:00100000:3.0:1787388125.017064:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990976 00000100:00100000:3.0:1787388125.017075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990336 00000100:00100000:3.0:1787388125.017077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990336 00000100:00100000:3.0:1787388125.017089:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990848 00000100:00100000:3.0:1787388125.017091:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990848 00000100:00100000:3.0:1787388125.017105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 309 00000100:00100000:3.0:1787388125.017111:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952990464:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388125.017140:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952990464:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.017147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 309 00000100:00100000:3.0:1787388125.017158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 310 00000100:00100000:3.0:1787388125.017165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952990976:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388125.017205:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952990976:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 40us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.017211:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 310 00000100:00100000:3.0:1787388125.017224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 311 00000100:00100000:3.0:1787388125.017230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+14:2404:x1874211952990336:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388125.017259:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+14:2404:x1874211952990336:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 29us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.017265:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 311 00000100:00100000:3.0:1787388125.017276:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 312 00000100:00100000:3.0:1787388125.017282:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2404:x1874211952990848:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388125.017305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2404:x1874211952990848:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 22us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.017321:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 312 00000100:00080000:3.0:1787388125.017349:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388125.017355:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388125.017358:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388125.017360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388125.017604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952990208 00000100:00100000:2.0:1787388125.017609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952990208 00000100:00100000:2.0:1787388125.017642:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 386 00000100:00100000:2.0:1787388125.017649:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952990208:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388125.017711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952990208:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 62us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388125.017718:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 386 00000001:00080000:3.0:1787388125.194265:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:3.0:1787388125.194282:0:6499:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787388125.194343:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787388125.194356:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787388125.325048:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787388125.630486:0:14564:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:42:04 (1787388124) 00010000:00010000:0.0:1787388126.344233:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388127.259099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388127.263794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952991232 00000100:00100000:1.0:1787388127.263812:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952991232 00000100:00100000:1.0:1787388127.263922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 150 00000100:00100000:1.0:1787388127.263936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+13:12197:x1874211952991232:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388127.263982:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388127.264004:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181249a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264099:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264115:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264129:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264146:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264153:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264178:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264285:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264294:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264301:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388127.264311:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787388127.264426:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264433:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264439:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264444:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388127.264448:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264455:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264467:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9273fbd42700) 00010000:00010000:1.0:1787388127.264469:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388127.264482:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264489:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18124a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264502:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264508:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264513:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264518:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388127.264520:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264526:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264534:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9273d13bc000) 00010000:00010000:1.0:1787388127.264536:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388127.264539:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264543:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264862:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181249a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e72 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264889:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e72 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388127.264896:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:1.0:1787388127.264898:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388127.264901:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4e00, rc 0) 00000100:00100000:1.0:1787388127.264974:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+15:12197:x1874211952991232:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 1042us (5894us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787388127.264982:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 150 00000100:00080000:3.0:1787388127.265582:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388127.272318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388127.272458:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952991360 00000100:00100000:1.0:1787388127.272469:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952991360 00000100:00100000:1.0:1787388127.272537:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 151 00000100:00100000:1.0:1787388127.272547:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+15:12197:x1874211952991360:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787388127.272673:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+15:12197:x1874211952991360:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 Request processed in 128us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388127.272711:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 151 00000100:00100000:3.0:1787388127.280027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388127.280240:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952991488 00000100:00100000:2.0:1787388127.280249:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952991488 00000100:00100000:2.0:1787388127.280316:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:2.0:1787388127.280327:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+15:2403:x1874211952991488:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388127.280344:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388127.280369:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e72 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388127.280390:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:2.0:1787388127.280396:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388127.280455:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+14:2403:x1874211952991488:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 130us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388127.280463:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:0.0:1787388127.286078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388127.286669:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952991616 00000100:00100000:1.0:1787388127.286709:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952991616 00000100:00100000:1.0:1787388127.286789:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 152 00000100:00100000:1.0:1787388127.286800:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:12197:x1874211952991616:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787388127.286899:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:12197:x1874211952991616:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 Request processed in 101us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388127.286907:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 152 00000100:00080000:3.0:1787388127.287600:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787388127.368126:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388127.559881:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388127.559903:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388127.560356:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787388127.560368:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388127.754504:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971935744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388127.754576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388127.754652:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935744 00000100:00100000:2.0:1787388127.754659:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935744 00000100:00100000:2.0:1787388127.754738:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787388127.754748:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971935744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388127.754793:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787388127.754840:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971935744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388127.754848:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787388127.754870:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388127.754904:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971935744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388127.756013:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971935872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388127.756061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388127.756111:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971935872 00000100:00100000:1.0:1787388127.756117:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971935872 00000100:00100000:1.0:1787388127.756159:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787388127.756167:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971935872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388127.756184:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388127.756220:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971935872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388127.756226:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787388127.756263:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971935872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787388127.758778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787388127.954261:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388128.264944:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388128.264972:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971936000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388128.265162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388128.265253:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971936000 00000100:00100000:3.0:1787388128.265261:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971936000 00000100:00100000:3.0:1787388128.265313:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787388128.265322:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971936000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388128.265359:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388128.265411:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971936000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388128.265419:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787388128.265503:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971936000:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388128.394527:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388128.584816:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388128.584826:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388128.584948:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787388128.584956:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787388128.968249:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388129.172385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.174280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952991744 00000100:00100000:1.0:1787388129.174295:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952991744 00000100:00100000:1.0:1787388129.174414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 153 00000100:00100000:1.0:1787388129.174424:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+14:12239:x1874211952991744:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388129.174443:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388129.174463:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18124bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e79 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174523:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174544:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174557:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174573:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174581:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174588:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174630:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174636:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174643:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174649:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388129.174653:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174660:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174670:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:1.0:1787388129.174697:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388129.174702:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174708:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18124c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174720:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174726:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174732:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174737:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388129.174740:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174745:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174752:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9273d13bc000) 00010000:00010000:1.0:1787388129.174754:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388129.174757:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174762:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18124cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174790:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18124bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e79 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174810:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:1.0:1787388129.174812:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388129.174816:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18124bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e79 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.174824:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4800, rc 0) 00000100:00100000:1.0:1787388129.175042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+14:12239:x1874211952991744:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 618us (2676us total) trans 0 rc 301/301 00000100:00100000:1.0:1787388129.175050:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 153 00000100:00100000:3.0:1787388129.178221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.178359:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992000 00000100:00100000:1.0:1787388129.178380:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992000 00000100:00100000:1.0:1787388129.178451:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 154 00000100:00100000:1.0:1787388129.178461:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+14:12239:x1874211952992000:12345-192.168.204.52@tcp:36:lfs.0 00010000:00010000:1.0:1787388129.178519:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388129.178545:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b1811e11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c9d expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.178562:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:1.0:1787388129.178567:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388129.178624:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.178639:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 5 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.178647:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.178719:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 5 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.178733:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 5 pid: 13489 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388129.178749:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffaf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971936128:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388129.178997:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4ecc0 going to sleep for 11 seconds 00000100:00080000:2.0:1787388129.181791:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388129.185389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.185432:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992128 00000100:00100000:1.0:1787388129.185441:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992128 00010000:00010000:1.0:1787388129.185495:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 6 pid: 13489 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388129.185529:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 81 00000100:00100000:1.0:1787388129.185538:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2403:x1874211952992128:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388129.185555:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388129.185562:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 6 pid: 13489 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.185576:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 6 pid: 13489 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.185599:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:1.0:1787388129.185605:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.185627:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.185635:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.185653:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388129.185732:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2403:x1874211952992128:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 194us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.185740:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 81 00010000:00010000:3.0:1787388129.186161:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b1812493 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e6b expref: 5 pid: 13489 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388129.186179:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffaf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971936128:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388129.186208:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.186218:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.186223:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.186248:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.186257:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.186265:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787388129.187580:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388129.187924:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.187939:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.187948:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388129.187965:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060b80fb0 reply state 000000007e597f1d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.187977:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.187997:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388129.187999:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388129.188003:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787388129.188010:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787388129.188017:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188024:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188029:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188035:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388129.188039:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188046:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188054:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273da1a0c00) 00010000:00010000:3.0:1787388129.188057:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388129.188060:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188065:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18124d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388129.188080:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060b80fb0 reply state 000000007e597f1d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188099:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.188105:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9273da1a0000) 00010000:00010000:3.0:1787388129.188107:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388129.188109:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787388129.188208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+15:12239:x1874211952992000:12345-192.168.204.52@tcp:36:lfs.0 Request processed in 9745us (9993us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787388129.188217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 154 00000100:00100000:1.0:1787388129.285813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388129.286848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992256 00000100:00100000:2.0:1787388129.286863:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992256 00000100:00100000:2.0:1787388129.286940:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 155 00000100:00100000:2.0:1787388129.286951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+15:12247:x1874211952992256:12345-192.168.204.52@tcp:101:lctl.0 00010000:00010000:2.0:1787388129.286977:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388129.287005:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18124e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e80 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.287752:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18124ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.287767:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18124ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.287779:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18124ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388129.287844:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388129.287848:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388129.287871:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18124ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.287913:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b18124e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e80 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.287936:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18124ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e80 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.287946:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:2.0:1787388129.287950:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388129.287954:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffe00, rc 0) 00000100:00100000:3.0:1787388129.291493:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+16:12247:x1874211952992256:12345-192.168.204.52@tcp:101:lctl.0 Request processed in 4529us (5681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.291506:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 155 00000100:00100000:2.0:1787388129.359207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388129.359393:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992384 00000100:00100000:0.0:1787388129.359406:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992384 00000100:00100000:0.0:1787388129.359468:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 156 00000100:00100000:0.0:1787388129.359478:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+16:12253:x1874211952992384:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388129.359500:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388129.359520:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18124f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e87 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.359605:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.359620:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.359632:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.359643:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.359650:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.359657:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360004:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b181250a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360014:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b181250a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360021:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b181250a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388129.360055:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787388129.360058:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388129.360081:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b181250a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360094:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360109:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360116:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360122:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388129.360127:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360135:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360147:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:2.0:1787388129.360151:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388129.360155:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360162:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18124fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360192:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360199:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360208:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360213:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388129.360223:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360230:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360238:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9273da1a0000) 00010000:00010000:2.0:1787388129.360241:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388129.360244:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360250:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812503 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360278:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18124f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e87 expref: 18 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360292:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b181250a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e87 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.360300:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388129.360302:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787388129.360305:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fec00, rc 0) 00000100:00100000:2.0:1787388129.360553:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+17:12253:x1874211952992384:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1076us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388129.360561:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 156 00000100:00100000:0.0:1787388129.363674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.363927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992640 00000100:00100000:3.0:1787388129.363940:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992640 00000100:00100000:3.0:1787388129.364050:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 157 00000100:00100000:3.0:1787388129.364062:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+17:12253:x1874211952992640:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388129.364087:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388129.364109:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812511 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e8e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.364237:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.364251:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.364262:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.364296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.364302:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.364308:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388129.364660:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787388129.365232:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365244:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365253:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365287:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365294:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365301:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365308:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388129.365313:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365333:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365446:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388129.365450:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388129.365455:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365461:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812518 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388129.365475:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000853330fb reply state 00000000ebb0c762 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365486:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365493:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:3.0:1787388129.365495:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388129.365498:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787388129.365529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812511 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365544:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.365552:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:3.0:1787388129.365554:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388129.365557:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:3.0:1787388129.365623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+20:12253:x1874211952992640:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1564us (1961us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787388129.365637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 157 00000100:00100000:1.0:1787388129.368981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.371222:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992768 00000100:00100000:3.0:1787388129.371240:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992768 00000100:00100000:3.0:1787388129.371520:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00080000:2.0:1787388129.371553:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388129.371607:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211952992768:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388129.371627:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388129.371740:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e95 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388129.371770:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388129.371796:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1787388129.371801:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388129.371813:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.371835:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.371850:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496e00, rc 0) 00000100:00100000:3.0:1787388129.372080:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2403:x1874211952992768:12345-192.168.204.52@tcp:101:bash.0 Request processed in 548us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.372088:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:2.0:1787388129.379591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.379674:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952992896 00000100:00100000:3.0:1787388129.379722:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952992896 00000100:00100000:3.0:1787388129.379774:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:3.0:1787388129.379793:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+6:12253:x1874211952992896:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388129.379828:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388129.379856:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4e9c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.379890:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.379912:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388129.379916:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388129.379923:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.379960:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.379975:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388129.379999:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3f9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874211971936256:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388129.380109:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388129.384280:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3f9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874211971936256:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388129.384400:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.384424:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496000, rc 0) 00000100:00100000:3.0:1787388129.384619:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:12253:x1874211952992896:12345-192.168.204.52@tcp:101:bash.0 Request processed in 4826us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.384628:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:2.0:1787388129.385814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.386756:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952993024 00000100:00100000:3.0:1787388129.386770:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952993024 00010000:00010000:3.0:1787388129.386836:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388129.386883:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 82 00000100:00100000:3.0:1787388129.386904:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952993024:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388129.386921:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388129.386946:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.386961:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.387774:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812534 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e95 expref: 7 pid: 8436 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.387852:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388129.387856:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388129.387867:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.387876:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.387948:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388129.387963:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3f9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874211971936384:192.168.204.52@tcp:105: 00000100:00100000:3.0:1787388129.388513:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388129.395020:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3f9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874211971936384:192.168.204.52@tcp:105: 00010000:00010000:3.0:1787388129.395049:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388129.395113:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952993024:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 8220us (9304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.395125:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 82 00000100:00100000:0.0:1787388129.400232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.400375:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952993280 00000100:00100000:1.0:1787388129.400386:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952993280 00000100:00100000:1.0:1787388129.400451:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:1.0:1787388129.400461:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+20:12253:x1874211952993280:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:1.0:1787388129.400837:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+21:12253:x1874211952993280:12345-192.168.204.52@tcp:35:bash.0 Request processed in 375us (615us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787388129.400846:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 36 00010000:00010000:2.0:1787388129.417760:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388129.541171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.541280:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952993536 00000100:00100000:3.0:1787388129.541291:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952993536 00000100:00100000:3.0:1787388129.541360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 158 00000100:00100000:3.0:1787388129.541371:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+21:12263:x1874211952993536:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388129.541400:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388129.541422:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ea3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388129.541551:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787388129.541650:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812542 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ea3 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.541666:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:3.0:1787388129.541670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388129.541722:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ea3 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.541743:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496e00, rc 0) 00000100:00100000:3.0:1787388129.541819:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+22:12263:x1874211952993536:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 450us (660us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1787388129.541827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 158 00000100:00100000:0.0:1787388129.549071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.549172:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952993792 00000100:00100000:1.0:1787388129.549182:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952993792 00000100:00100000:1.0:1787388129.549241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:1.0:1787388129.549251:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+22:12263:x1874211952993792:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388129.549493:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+23:12263:x1874211952993792:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 243us (432us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787388129.549502:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:0.0:1787388129.645113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.646855:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952993920 00000100:00100000:3.0:1787388129.646875:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952993920 00000100:00100000:3.0:1787388129.647160:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 159 00000100:00100000:3.0:1787388129.647173:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+23:12269:x1874211952993920:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388129.647201:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388129.647226:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4eaa expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.647307:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.647324:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.647337:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388129.647408:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787388129.647413:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388129.647438:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.647468:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eaa expref: 25 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.647508:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eaa expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.647518:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388129.647521:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388129.647538:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496200, rc 0) 00000100:00100000:3.0:1787388129.647608:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+24:12269:x1874211952993920:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 438us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.647616:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 159 00000100:00100000:3.0:1787388129.656138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.656278:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952994176 00000100:00100000:1.0:1787388129.656292:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952994176 00000100:00100000:1.0:1787388129.656372:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 160 00000100:00100000:1.0:1787388129.656384:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+24:12269:x1874211952994176:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388129.656412:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388129.656436:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181255e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4eb1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.656575:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.656589:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.656601:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388129.656612:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787388129.656754:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181255e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb1 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.656773:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb1 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.656782:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:1.0:1787388129.656785:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388129.656788:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b5a00, rc 0) 00000100:00100000:1.0:1787388129.656862:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+26:12269:x1874211952994176:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 480us (735us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787388129.656899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 160 00000100:00100000:0.0:1787388129.661753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388129.661800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.661905:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952994304 00000100:00100000:1.0:1787388129.661916:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952994304 00000100:00100000:1.0:1787388129.661996:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:1.0:1787388129.662008:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+26:2403:x1874211952994304:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388129.662024:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388129.662054:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb1 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.662077:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:1.0:1787388129.662082:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388129.662154:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+25:2403:x1874211952994304:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 147us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.662163:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:2.0:1787388129.663026:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952994560 00000100:00100000:2.0:1787388129.663035:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952994560 00000100:00100000:2.0:1787388129.663085:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 161 00000100:00100000:2.0:1787388129.663094:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+25:12269:x1874211952994560:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388129.663116:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388129.663133:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812573 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4eb8 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.663241:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181257a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.663256:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181257a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.663268:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181257a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388129.663283:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787388129.663402:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812573 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb8 expref: 28 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.663419:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181257a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb8 expref: 27 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.663427:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:2.0:1787388129.663430:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787388129.663434:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff600, rc 0) 00000100:00100000:2.0:1787388129.663481:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+27:12269:x1874211952994560:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 388us (1680us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1787388129.663506:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 161 00000100:00100000:0.0:1787388129.675002:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.675157:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952994688 00000100:00100000:3.0:1787388129.675167:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952994688 00000100:00100000:3.0:1787388129.675248:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:3.0:1787388129.675259:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952994688:12345-192.168.204.52@tcp:1:lfs.0 00010000:00010000:3.0:1787388129.675308:0:10361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.675329:0:10361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.675338:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388129.675342:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388129.675346:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.675621:0:10361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.675636:0:10361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 6 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388129.675651:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10361:1874211971936512:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388129.677370:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388129.681170:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10361:1874211971936512:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388129.681200:0:10361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388129.681351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.681817:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952994816 00000100:00100000:3.0:1787388129.681825:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952994816 00002000:00100000:3.0:1787388129.681948:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9273c6861500 x1874211952994816/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:385/0 lens 504/0 e 0 to 0 dl 1787388140 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388129.681961:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273c6861500 with x1874211952994816 ext(0->12) 00010000:00010000:3.0:1787388129.681970:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 7 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.682067:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 7 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388129.682075:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9273c6861500 00000100:00100000:3.0:1787388129.682181:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:3.0:1787388129.682191:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952994816:12345-192.168.204.52@tcp:4:lfs.0 00000100:00100000:3.0:1787388129.683644:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+9:2404:x1874211952994816:12345-192.168.204.52@tcp:4:lfs.0 Request processed in 1448us (2665us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787388129.683657:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 2 00002000:00100000:3.0:1787388129.683667:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9273c6861500 x1874211952994816/t4294967306(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:385/0 lens 504/448 e 0 to 0 dl 1787388140 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388129.683703:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273c6861500 with x1874211952994816 ext(0->12) 00010000:00010000:3.0:1787388129.683713:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.683729:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388129.683738:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9273c6861500 00000100:00100000:1.0:1787388129.687757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388129.687851:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952994944 00000100:00100000:2.0:1787388129.687861:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952994944 00010000:00010000:2.0:1787388129.688049:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388129.688130:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 83 00000100:00100000:2.0:1787388129.688141:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+9:2403:x1874211952994944:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388129.688157:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787388129.688175:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787388129.688178:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787388129 00002000:00010000:2.0:1787388129.688181:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787388129 00002000:00010000:2.0:1787388129.688183:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787388129 00002000:00010000:2.0:1787388129.688185:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787388129.688191:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.688206:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.688230:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181253b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e9c expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.688247:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388129.688251:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388129.688258:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.688281:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.688319:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388129.688394:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211952994944:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 248us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388129.688402:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 83 00010000:00010000:0.0:1787388129.688467:0:10361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688487:0:10361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688506:0:10361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688515:0:10361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688535:0:10361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688544:0:10361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388129.688548:0:10361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688558:0:10361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688570:0:10361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.688578:0:10361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254170e6/0x5cb77467b1812588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388129.688635:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211952994688:12345-192.168.204.52@tcp:1:lfs.0 Request processed in 13378us (13654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.688643:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:0.0:1787388129.692315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.692643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952995200 00000100:00100000:1.0:1787388129.692653:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952995200 00000100:00100000:1.0:1787388129.692831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 38 00000100:00100000:1.0:1787388129.692842:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+27:12269:x1874211952995200:12345-192.168.204.52@tcp:35:lfs.0 00000004:00010000:1.0:1787388129.692932:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181257a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb8 expref: 27 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388129.694157:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787388129.694215:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1787388129.694642:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:1.0:1787388129.694797:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.694834:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.694843:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.694969:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.695055:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 31 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388129.695072:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874211971936640:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388129.695196:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787388129.700004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388129.700136:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952995328 00000100:00100000:0.0:1787388129.700147:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952995328 00010000:00010000:0.0:1787388129.700193:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 32 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388129.700237:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 84 00000100:00100000:0.0:1787388129.700248:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+32:2403:x1874211952995328:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388129.700265:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388129.700272:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 32 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.700285:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 32 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.700307:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:0.0:1787388129.700312:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.700321:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.700328:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.700756:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388129.700818:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+32:2403:x1874211952995328:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 569us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.700827:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 84 00010000:00010000:2.0:1787388129.702299:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e8e expref: 31 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388129.702322:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874211971936640:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388129.702348:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.702368:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.702374:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388129.702658:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1787388129.702796:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1787388129.702970:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971936768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787388129.703039:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388129.703071:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388129.703245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971936768 00000100:00100000:1.0:1787388129.703252:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971936768 00000100:00100000:1.0:1787388129.703313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787388129.703322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874211971936768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787388129.703654:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874211971936768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 332us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.703663:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787388129.703768:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971936768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787388129.703967:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1787388129.704095:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971936896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787388129.704129:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.704157:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388129.704213:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971936896 00000100:00100000:1.0:1787388129.704218:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971936896 00000100:00100000:1.0:1787388129.704251:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787388129.704258:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1874211971936896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787388129.704509:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1874211971936896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 250us (378us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787388129.704517:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1787388129.704764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388129.704969:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971936896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787388129.705091:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1787388129.705133:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.705145:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.705152:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.705159:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388129.705164:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.705173:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.705190:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:0.0:1787388129.705202:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787388129.705207:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.705214:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181258f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388129.705314:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787388129.705580:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787388129.705593:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418689912656ns, next at 419689909934ns, rc = 0 00000001:00080000:0.0:1787388129.705599:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1787388129.705623:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0b00) 00010000:00010000:0.0:1787388129.705625:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787388129.705632:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b181257a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eb8 expref: 35 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388129.705827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+34:12269:x1874211952995200:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 12986us (13521us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787388129.705836:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 38 00000020:00080000:0.0:1787388129.705840:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787388129.709284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.709379:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952995456 00000100:00100000:3.0:1787388129.709397:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952995456 00000100:00100000:3.0:1787388129.709491:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 162 00000100:00100000:3.0:1787388129.709502:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+34:12269:x1874211952995456:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388129.709528:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388129.709552:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812596 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ebf expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.709605:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ebf expref: 35 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.709638:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ebf expref: 35 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388129.709658:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388129.709661:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388129.709664:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497400, rc 0) 00000100:00100000:3.0:1787388129.709743:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+35:12269:x1874211952995456:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 243us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.709751:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 162 00000100:00100000:1.0:1787388129.714104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.714195:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952995712 00000100:00100000:3.0:1787388129.714206:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952995712 00000100:00100000:3.0:1787388129.714264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 39 00000100:00100000:3.0:1787388129.714274:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+35:12269:x1874211952995712:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:3.0:1787388129.714796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+36:12269:x1874211952995712:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 404us (584us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787388129.714805:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 39 00000100:00100000:2.0:1787388129.800149:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971937024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388129.800234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388129.800327:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937024 00000100:00100000:2.0:1787388129.800333:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937024 00000100:00100000:2.0:1787388129.800376:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787388129.800383:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971937024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388129.800404:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388129.800437:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874211971937024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388129.800444:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787388129.800624:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971937280:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.800663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.800699:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971937792:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.800721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.800736:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971938304:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.800761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.800777:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787388129.800782:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971937408:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.800807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.800821:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971937920:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.800839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.800854:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971938432:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.800883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.800925:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937280 00000100:00100000:3.0:1787388129.800929:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937280 00000100:00100000:3.0:1787388129.800958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787388129.800964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971937280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801000:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971937280:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787388129.801046:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937920 00000100:00100000:3.0:1787388129.801050:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937920 00000100:00100000:3.0:1787388129.801084:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787388129.801089:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971937920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801120:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971937920:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787388129.801140:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388129.801152:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971937536:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801175:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.801191:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971938048:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.801241:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971937024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388129.801267:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787388129.801272:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971937152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388129.801296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.801308:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971937664:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.801340:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971938176:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801357:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.801380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971938304 00000100:00100000:3.0:1787388129.801384:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971938304 00000100:00100000:3.0:1787388129.801409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937408 00000100:00100000:3.0:1787388129.801412:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937408 00000100:00100000:3.0:1787388129.801424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971938432 00000100:00100000:3.0:1787388129.801426:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971938432 00000100:00100000:3.0:1787388129.801439:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937664 00000100:00100000:3.0:1787388129.801441:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937664 00000100:00100000:3.0:1787388129.801452:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971938176 00000100:00100000:3.0:1787388129.801454:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971938176 00000100:00100000:3.0:1787388129.801465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787388129.801470:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971938304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801502:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971938304:12345-0@lo:400:kworker.0 Request processed in 31us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801508:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787388129.801519:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787388129.801539:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971937408:12345-0@lo:400:kworker.0 Request processed in 41us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787388129.801592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787388129.801597:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971938432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971938432:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787388129.801641:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787388129.801647:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971937664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801697:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971937664:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787388129.801714:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787388129.801719:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971938176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971938176:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:3.0:1787388129.801762:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388129.801765:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388129.801773:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937792 00000100:00100000:3.0:1787388129.801776:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937792 00000100:00100000:3.0:1787388129.801790:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937536 00000100:00100000:3.0:1787388129.801792:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937536 00000100:00100000:3.0:1787388129.801801:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971937152 00000100:00100000:3.0:1787388129.801803:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971937152 00000100:00100000:3.0:1787388129.801811:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787388129.801817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971937792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801860:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971937792:12345-0@lo:400:kworker.0 Request processed in 42us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801874:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787388129.801897:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787388129.801904:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971937536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.801932:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971937536:12345-0@lo:400:kworker.0 Request processed in 29us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.801938:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787388129.801948:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787388129.801953:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971937152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388129.801974:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787388129.802001:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971937152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.802006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787388129.802032:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971937408:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802044:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971937920:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802054:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971938432:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802063:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971937280:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802071:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971937792:0@lo:400:kworker.0 00010000:00080000:3.0:1787388129.802083:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2f74380 x1874211971938304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388129.802093:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971938304:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802135:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971937152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388129.802156:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971937664:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802164:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971938176:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802172:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971937536:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802196:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971938048 00000100:00100000:3.0:1787388129.802199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971938048 00000100:00100000:3.0:1787388129.802225:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787388129.802230:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971938048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.802261:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971938048:12345-0@lo:400:kworker.0 Request processed in 30us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.802267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787388129.802279:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388129.802295:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971938048:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.803206:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388129.803220:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971938560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388129.803269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.803896:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971938560 00000100:00100000:0.0:1787388129.803903:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971938560 00000100:00100000:0.0:1787388129.803968:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787388129.803976:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273efdba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971938560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388129.803994:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787388129.804120:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388129.805058:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273efdba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971938560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1079us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.805068:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787388129.805298:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388129.805314:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971938688:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.806262:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971938560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388129.806741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388129.806846:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971938688 00000100:00100000:1.0:1787388129.806853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971938688 00000100:00080000:2.0:1787388129.806983:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388129.807022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787388129.807032:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971938688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.807104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971938688:12345-0@lo:400:kworker.0 Request processed in 73us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.807113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:2.0:1787388129.807177:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c44e9f80 x1874211971938688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388129.807191:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971938688:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.810392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388129.811074:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952995968 00000100:00100000:0.0:1787388129.811108:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952995968 00000100:00100000:0.0:1787388129.811175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 163 00000100:00100000:0.0:1787388129.811187:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+36:12279:x1874211952995968:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388129.811211:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388129.811233:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181259d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ec6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388129.811346:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787388129.811460:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181259d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ec6 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.811475:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:0.0:1787388129.811477:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388129.811482:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b181259d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ec6 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.811498:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa800, rc 0) 00000100:00100000:0.0:1787388129.812714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+37:12279:x1874211952995968:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1523us (2756us total) trans 4294967436 rc 301/301 00000100:00100000:0.0:1787388129.812726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 163 00000100:00100000:1.0:1787388129.815467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388129.815550:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952996096 00000100:00100000:2.0:1787388129.815560:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952996096 00000100:00100000:2.0:1787388129.815658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 164 00000100:00100000:2.0:1787388129.815668:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+37:12279:x1874211952996096:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:2.0:1787388129.815767:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815783:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815811:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815823:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815831:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815837:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815929:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815937:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815943:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388129.815986:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.815997:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816004:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816025:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388129.816029:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816037:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816049:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388129.816052:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388129.816055:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816062:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816074:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816080:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816087:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816091:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388129.816094:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816100:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816114:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388129.816117:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388129.816119:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816124:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b18125b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816133:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816138:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816144:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816149:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388129.816152:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816158:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816164:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388129.816166:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388129.816168:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388129.816173:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18125b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388129.816250:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+37:12279:x1874211952996096:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 583us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388129.816258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 164 00000100:00100000:1.0:1787388129.820210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388129.820367:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952996352 00000100:00100000:3.0:1787388129.820380:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952996352 00000100:00100000:3.0:1787388129.820450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:3.0:1787388129.820463:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+37:12279:x1874211952996352:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:3.0:1787388129.820732:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+38:12279:x1874211952996352:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 271us (531us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787388129.820742:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:3.0:1787388129.847639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388129.847724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952996608 00000100:00100000:1.0:1787388129.847736:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952996608 00000100:00100000:1.0:1787388129.847802:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 165 00000100:00100000:1.0:1787388129.847813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+38:12282:x1874211952996608:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388129.847837:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388129.847858:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18125c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ecd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.847976:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.847991:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848003:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848021:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848028:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848153:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848162:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848169:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388129.848182:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787388129.848264:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848272:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848286:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848292:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388129.848298:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848305:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848318:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:1.0:1787388129.848321:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388129.848325:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848332:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b18125c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848361:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848367:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848374:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.848379:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388129.848382:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.849797:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.849822:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:1.0:1787388129.849825:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388129.849831:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.849837:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18125ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.849910:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18125c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.849925:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388129.849934:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388129.849936:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388129.849939:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4600, rc 0) 00000100:00100000:1.0:1787388129.851483:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+40:12282:x1874211952996608:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 3662us (3844us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787388129.851495:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 165 00000100:00100000:3.0:1787388129.854878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388129.854941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952996736 00000100:00100000:0.0:1787388129.854957:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952996736 00000100:00100000:0.0:1787388129.855025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 166 00000100:00100000:0.0:1787388129.855035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+40:12282:x1874211952996736:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388129.855110:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855130:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855155:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855196:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855204:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855212:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855218:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388129.855223:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855230:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855242:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388129.855245:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388129.855249:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388129.855255:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18125e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388129.855393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+40:12282:x1874211952996736:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 358us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.855402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 166 00000100:00100000:3.0:1787388129.856992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388129.857081:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952996992 00000100:00100000:0.0:1787388129.857099:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952996992 00000100:00100000:0.0:1787388129.857175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:0.0:1787388129.857184:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+40:12282:x1874211952996992:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388129.857425:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+41:12282:x1874211952996992:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 241us (439us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787388129.857433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:3.0:1787388130.068922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.069373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952997248 00000100:00100000:2.0:1787388130.069383:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952997248 00000100:00100000:2.0:1787388130.069446:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 167 00000100:00100000:2.0:1787388130.069457:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+41:12313:x1874211952997248:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:2.0:1787388130.069484:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388130.069506:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ed4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.069614:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18125f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.069630:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18125f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.069644:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18125f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388130.069657:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787388130.069799:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ed4 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.069819:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18125f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ed4 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.069828:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388130.069840:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388130.069844:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff800, rc 0) 00000100:00100000:2.0:1787388130.071375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+43:12313:x1874211952997248:12345-192.168.204.52@tcp:101:cat.0 Request processed in 1911us (2456us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787388130.071388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 167 00000100:00100000:2.0:1787388130.082871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.083036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.083124:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952997632 00000100:00100000:0.0:1787388130.083133:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952997632 00000100:00100000:0.0:1787388130.083199:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:0.0:1787388130.083209:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+43:2402:x1874211952997632:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388130.083226:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388130.083252:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18125f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ed4 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.083273:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388130.083278:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388130.083336:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+42:2402:x1874211952997632:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388130.083344:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:3.0:1787388130.089406:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952997504 00000100:00100000:3.0:1787388130.089423:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952997504 00000100:00100000:0.0:1787388130.089795:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:0.0:1787388130.089812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+42:12313:x1874211952997504:12345-192.168.204.52@tcp:35:cat.0 00000100:00100000:0.0:1787388130.090112:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+43:12313:x1874211952997504:12345-192.168.204.52@tcp:35:cat.0 Request processed in 305us (7252us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787388130.090121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:2.0:1787388130.145721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.145766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.145872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.145913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388130.145915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952997760 00000100:00100000:3.0:1787388130.145925:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952997760 00000100:00100000:2.0:1787388130.145944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.145987:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952998272 00000100:00100000:2.0:1787388130.145992:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952998272 00000100:00100000:3.0:1787388130.145993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 388 00000100:00100000:3.0:1787388130.146006:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952997760:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388130.146035:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952997888 00000100:00100000:2.0:1787388130.146039:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952997888 00000100:00100000:2.0:1787388130.146059:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952998144 00000100:00100000:2.0:1787388130.146061:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952998144 00000100:00100000:3.0:1787388130.146077:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211952997760:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 73us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388130.146080:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 319 00000100:00100000:2.0:1787388130.146091:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952998272:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388130.146093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 388 00000100:00100000:2.0:1787388130.146135:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952998272:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388130.146143:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 320 00000100:00100000:3.0:1787388130.146152:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952997888:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388130.146181:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211952997888:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388130.146196:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952998016 00000100:00100000:0.0:1787388130.146216:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952998016 00000100:00100000:0.0:1787388130.146254:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 132 00000100:00100000:0.0:1787388130.146262:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952998016:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388130.146292:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211952998016:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388130.146299:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 132 00000100:00100000:2.0:1787388130.146341:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 319 00000100:00100000:2.0:1787388130.146359:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 321 00000100:00100000:2.0:1787388130.146366:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952998144:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388130.146414:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211952998144:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 49us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388130.146430:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 321 00000100:00080000:2.0:1787388130.146448:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388130.146452:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388130.148349:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 320 00000100:00100000:1.0:1787388130.156344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.169714:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952998528 00000100:00100000:2.0:1787388130.169731:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952998528 00000100:00100000:2.0:1787388130.169822:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 168 00000100:00100000:2.0:1787388130.169833:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+43:12319:x1874211952998528:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:2.0:1787388130.169857:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388130.169861:0:13489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388130.169902:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4eaa expref: 43 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.169928:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388130.169933:0:13489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388130.169953:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4edb expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.170066:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.170079:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.170087:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.170122:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.170155:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 43 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388130.170171:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971938816:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388130.170292:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388130.174355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.174457:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971938816:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388130.174497:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388130.174639:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952998656 00000100:00100000:3.0:1787388130.174646:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952998656 00010000:00010000:3.0:1787388130.174716:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 44 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388130.174745:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 85 00000100:00100000:3.0:1787388130.174753:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+44:2403:x1874211952998656:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388130.174767:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388130.174773:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 44 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.174794:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 44 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.174828:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18125d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ecd expref: 44 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.174841:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388130.174845:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.174854:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.174860:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.174892:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388130.174943:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+43:2403:x1874211952998656:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 191us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388130.174951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 85 00010000:00010000:2.0:1787388130.175066:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.175074:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388130.175093:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787388130.175229:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b18125ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 44 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.175244:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 43 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.175251:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388130.175253:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787388130.175256:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:2.0:1787388130.175281:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+43:12319:x1874211952998528:12345-192.168.204.52@tcp:101:dd.0 Request processed in 5450us (18948us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787388130.175294:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 168 00000100:00100000:3.0:1787388130.179716:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.180107:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952998784 00000100:00100000:0.0:1787388130.180119:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952998784 00000100:00100000:0.0:1787388130.180183:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 169 00000100:00100000:0.0:1787388130.180195:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+43:12319:x1874211952998784:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:0.0:1787388130.180222:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388130.180245:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812614 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ee2 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.180284:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.180299:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.180310:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.180471:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812614 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 45 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.180506:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 44 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.180528:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388130.180531:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388130.180535:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:0.0:1787388130.180650:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+44:12319:x1874211952998784:12345-192.168.204.52@tcp:101:dd.0 Request processed in 457us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388130.180657:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 169 00000100:00100000:1.0:1787388130.186309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.186804:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952999040 00000100:00100000:0.0:1787388130.186814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952999040 00000100:00100000:0.0:1787388130.187675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 170 00000100:00100000:0.0:1787388130.187724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+44:12319:x1874211952999040:12345-192.168.204.52@tcp:36:dd.0 00010000:00010000:0.0:1787388130.187981:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.187999:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.188012:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388130.188051:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787388130.188070:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc682c4e reply state 0000000062012f93 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.188082:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.188090:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388130.188093:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388130.188109:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388130.188205:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+47:12319:x1874211952999040:12345-192.168.204.52@tcp:36:dd.0 Request processed in 489us (1905us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787388130.188223:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 170 00000020:00080000:0.0:1787388130.188228:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787388130.440139:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388130.489212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388130.489369:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952999168 00000100:00100000:2.0:1787388130.489379:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952999168 00000100:00100000:2.0:1787388130.489442:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 171 00000100:00100000:2.0:1787388130.489453:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+47:12333:x1874211952999168:12345-192.168.204.52@tcp:101:stat.0 00010000:00010000:2.0:1787388130.489477:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388130.489500:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812629 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ee9 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489571:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489586:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489598:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489609:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489616:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489622:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489728:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489756:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 48 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489764:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489796:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 48 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.489809:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 48 pid: 13489 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388130.489823:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971938944:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388130.489951:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4ad53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388130.495619:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971938944:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388130.495654:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388130.497728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388130.498266:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952999424 00000100:00100000:3.0:1787388130.498279:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952999424 00000100:00100000:3.0:1787388130.498349:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:3.0:1787388130.498361:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+49:6171:x1874211952999424:12345-192.168.204.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787388130.498674:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+50:6171:x1874211952999424:12345-192.168.204.52@tcp:35:ldlm_bl.0 Request processed in 314us (955us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1787388130.498706:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:3.0:1787388130.501577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.501736:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952999552 00000100:00100000:0.0:1787388130.501747:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952999552 00010000:00010000:0.0:1787388130.501791:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 50 pid: 13489 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388130.502234:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 86 00000100:00100000:0.0:1787388130.502246:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+50:2404:x1874211952999552:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388130.502265:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388130.502274:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 50 pid: 13489 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.502289:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 50 pid: 13489 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.502311:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812606 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4edb expref: 50 pid: 13489 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.502331:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388130.502336:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.502481:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.502673:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.502774:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388130.503709:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+49:2404:x1874211952999552:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 1425us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388130.503722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 86 00010000:00010000:3.0:1787388130.503899:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.503910:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388130.503982:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787388130.503988:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388130.504015:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504031:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504045:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504052:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504058:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504064:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388130.504068:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504074:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.504089:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388130.504091:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388130.504095:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506056:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506080:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506087:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506094:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506099:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388130.506103:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506565:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506585:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:3.0:1787388130.506588:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388130.506594:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506600:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506650:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812629 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee9 expref: 49 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506718:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee9 expref: 48 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.506726:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388130.506728:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388130.506731:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff400, rc 0) 00000100:00100000:3.0:1787388130.509627:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+48:12333:x1874211952999168:12345-192.168.204.52@tcp:101:stat.0 Request processed in 17351us (17603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388130.509645:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 171 00000100:00100000:3.0:1787388130.563366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388130.563484:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952999808 00000100:00100000:1.0:1787388130.563496:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952999808 00000100:00100000:1.0:1787388130.563586:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 172 00000100:00100000:1.0:1787388130.563596:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+48:12339:x1874211952999808:12345-192.168.204.52@tcp:36:truncate.0 00010000:00010000:1.0:1787388130.563659:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388130.563731:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b181263e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee9 expref: 48 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.563754:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388130.563759:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388130.563993:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.564019:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.564030:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388130.564076:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1787388130.564100:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d32c9ffa reply state 00000000436b68a5 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.564112:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.564119:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388130.564122:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388130.564125:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388130.564233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+50:12339:x1874211952999808:12345-192.168.204.52@tcp:36:truncate.0 Request processed in 636us (892us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787388130.567068:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 172 00000020:00080000:1.0:1787388130.567114:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388130.698795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.698902:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211952999936 00000100:00100000:0.0:1787388130.698913:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211952999936 00000100:00100000:0.0:1787388130.698982:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 173 00000100:00100000:0.0:1787388130.698994:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+50:12353:x1874211952999936:12345-192.168.204.52@tcp:101:stat.0 00010000:00010000:0.0:1787388130.699019:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388130.699041:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181264c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ef0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699109:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699124:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699136:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699148:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699155:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699182:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699258:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699266:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699273:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388130.699315:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787388130.699320:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388130.699354:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699366:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699374:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699380:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699386:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699392:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388130.699396:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699411:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699424:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388130.699428:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388130.699433:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699439:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699454:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699461:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699467:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699471:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388130.699474:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699480:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699487:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:0.0:1787388130.699490:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388130.699493:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699509:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181265a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699537:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181264c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699551:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.699558:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388130.699560:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388130.699563:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa800, rc 0) 00000100:00100000:0.0:1787388130.699939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+51:12353:x1874211952999936:12345-192.168.204.52@tcp:101:stat.0 Request processed in 945us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388130.699946:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 173 00000100:00100000:0.0:1787388130.789394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388130.789705:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953000192 00000100:00100000:3.0:1787388130.789714:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953000192 00000100:00100000:3.0:1787388130.789777:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 174 00000100:00100000:3.0:1787388130.789787:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+51:12363:x1874211953000192:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388130.789811:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388130.789834:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ef7 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388130.789951:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787388130.790068:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812668 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef7 expref: 53 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.790086:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:3.0:1787388130.790089:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388130.790095:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef7 expref: 53 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.790137:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:3.0:1787388130.790228:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+52:12363:x1874211953000192:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 442us (841us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1787388130.790236:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 174 00000100:00100000:3.0:1787388130.794523:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.794794:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953000448 00000100:00100000:0.0:1787388130.794805:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953000448 00000100:00100000:0.0:1787388130.794880:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:0.0:1787388130.794893:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+52:12363:x1874211953000448:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388130.795155:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+53:12363:x1874211953000448:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 264us (642us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787388130.795164:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:1.0:1787388130.857759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388130.857843:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953000704 00000100:00100000:3.0:1787388130.857853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953000704 00000100:00100000:3.0:1787388130.857960:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 175 00000100:00100000:3.0:1787388130.857971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+53:12369:x1874211953000704:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388130.858002:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388130.858022:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812676 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4efe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.858126:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.858141:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.858149:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.858180:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.858192:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 54 pid: 6522 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388130.858223:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211971939072:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388130.858372:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388130.866515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388130.866719:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211971939072:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388130.866748:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388130.866881:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953000832 00000100:00100000:1.0:1787388130.866888:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953000832 00010000:00010000:1.0:1787388130.866923:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 55 pid: 6522 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388130.866950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 87 00000100:00100000:1.0:1787388130.866958:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+55:2404:x1874211953000832:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388130.866973:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388130.866980:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 55 pid: 6522 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.867002:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 55 pid: 6522 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.867025:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ef0 expref: 55 pid: 6522 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.867046:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388130.867051:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.867062:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.867070:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.867098:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388130.867162:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+54:2404:x1874211953000832:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 204us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388130.867170:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 87 00010000:00010000:3.0:1787388130.867258:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.867265:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388130.867285:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787388130.867417:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b1812676 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.867431:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388130.867438:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388130.867454:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388130.867457:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496000, rc 0) 00000100:00100000:3.0:1787388130.867482:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+54:12369:x1874211953000704:12345-192.168.204.52@tcp:101:bash.0 Request processed in 9513us (9807us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787388130.867489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 175 00000100:00100000:2.0:1787388130.881768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.881863:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953001088 00000100:00100000:0.0:1787388130.881882:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953001088 00000100:00100000:0.0:1787388130.881936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 176 00000100:00100000:0.0:1787388130.881958:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+54:12369:x1874211953001088:12345-192.168.204.52@tcp:36:bash.0 00010000:00010000:0.0:1787388130.882170:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.882185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.882196:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388130.882231:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:0.0:1787388130.882250:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0806ad3 reply state 00000000b8faaccc transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.882261:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.882269:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388130.882272:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388130.882275:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388130.882375:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+57:12369:x1874211953001088:12345-192.168.204.52@tcp:36:bash.0 Request processed in 417us (615us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787388130.882382:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 176 00000020:00080000:0.0:1787388130.882387:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388130.891763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.891853:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953001216 00000100:00100000:0.0:1787388130.891862:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953001216 00000100:00100000:0.0:1787388130.891932:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 177 00000100:00100000:0.0:1787388130.891942:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+57:12369:x1874211953001216:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388130.891967:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388130.891989:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f05 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.892100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.892115:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.892123:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.892156:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388130.892169:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 58 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388130.892183:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971939200:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388130.892316:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388130.901510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.902138:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971939200:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388130.902169:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388130.906987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953001344 00000100:00100000:1.0:1787388130.907005:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953001344 00010000:00010000:1.0:1787388130.907066:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 59 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388130.907119:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 88 00000100:00100000:1.0:1787388130.907130:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+59:2404:x1874211953001344:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388130.907145:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388130.907152:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 59 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.907165:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 59 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.907187:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b181267d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4efe expref: 59 pid: 6520 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.907206:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388130.907211:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.907220:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.907229:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388130.907285:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388130.907359:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+58:2404:x1874211953001344:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 232us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388130.907373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 88 00010000:00010000:2.0:1787388130.908599:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.908613:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388130.908720:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787388130.908725:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388130.908745:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.908780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f05 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.908799:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f05 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.908808:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388130.908810:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388130.908813:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb600, rc 0) 00000100:00100000:2.0:1787388130.908881:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+57:12369:x1874211953001216:12345-192.168.204.52@tcp:101:bash.0 Request processed in 16940us (17126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388130.908889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 177 00000100:00100000:2.0:1787388130.919951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388130.921094:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953001600 00000100:00100000:0.0:1787388130.921108:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953001600 00000100:00100000:0.0:1787388130.921182:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:0.0:1787388130.921192:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+57:12369:x1874211953001600:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:0.0:1787388130.921466:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+58:12369:x1874211953001600:12345-192.168.204.52@tcp:35:bash.0 Request processed in 274us (1525us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787388130.921489:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:3.0:1787388131.019517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.019716:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953001856 00000100:00100000:1.0:1787388131.019725:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953001856 00000100:00100000:1.0:1787388131.019803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 178 00000100:00100000:1.0:1787388131.019815:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+58:12379:x1874211953001856:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388131.019840:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388131.019861:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18126a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f0c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388131.019973:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787388131.020079:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18126a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f0c expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.020094:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:1.0:1787388131.020097:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388131.020102:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18126a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f0c expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.020115:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4600, rc 0) 00000100:00100000:1.0:1787388131.020167:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+59:12379:x1874211953001856:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 355us (660us total) trans 4294967454 rc 301/301 00000100:00100000:1.0:1787388131.020175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 178 00000100:00080000:2.0:1787388131.020451:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388131.023082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.023188:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953001984 00000100:00100000:2.0:1787388131.023200:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953001984 00000100:00100000:2.0:1787388131.023260:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 179 00000100:00100000:2.0:1787388131.023271:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+59:12379:x1874211953001984:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:2.0:1787388131.023368:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023386:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023414:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023427:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023436:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023456:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023541:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023550:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023557:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388131.023616:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023630:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023636:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023642:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023658:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.023662:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023671:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023729:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388131.023733:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.023739:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023745:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023765:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023771:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023778:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023783:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152bc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.023786:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023792:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023813:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388131.023816:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.023819:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023825:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023837:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023844:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023850:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023855:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.023858:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023875:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023883:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388131.023885:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.023888:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.023894:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.023990:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+59:12379:x1874211953001984:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 719us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.023999:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 179 00000100:00100000:2.0:1787388131.030467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.030579:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953002240 00000100:00100000:0.0:1787388131.030589:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953002240 00000100:00100000:0.0:1787388131.030646:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:0.0:1787388131.030656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+59:12379:x1874211953002240:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388131.030909:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+60:12379:x1874211953002240:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 253us (453us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787388131.030917:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:0.0:1787388131.063520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.064067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953002496 00000100:00100000:2.0:1787388131.064081:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953002496 00000100:00100000:2.0:1787388131.064210:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 180 00000100:00100000:2.0:1787388131.064222:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+60:12382:x1874211953002496:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388131.064250:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388131.064273:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f13 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.064369:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.064383:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.064394:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.064404:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.064412:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.064419:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065378:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18126d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065396:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18126d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065406:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18126d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388131.065421:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787388131.065529:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065537:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065545:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065550:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152bc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.065554:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065562:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065717:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388131.065720:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.065726:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065746:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152bc00/0x5cb77467b18126ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065768:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065774:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065779:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065784:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152b600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.065787:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065800:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:2.0:1787388131.065802:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.065805:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065811:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b600/0x5cb77467b18126d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c152b800/0x5cb77467b18126c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f13 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065889:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18126d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f13 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.065902:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388131.065904:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388131.065907:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709000, rc 0) 00000100:00100000:2.0:1787388131.065987:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+62:12382:x1874211953002496:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1767us (2477us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787388131.065996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 180 00000100:00100000:3.0:1787388131.075545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.075593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.075733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953002624 00000100:00100000:0.0:1787388131.075744:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953002624 00000100:00100000:0.0:1787388131.075797:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 181 00000100:00100000:0.0:1787388131.075806:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+62:12382:x1874211953002624:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388131.075884:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.075904:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.075916:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.075954:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.075961:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.076001:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.076007:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.076013:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.076021:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.076037:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.076041:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388131.076047:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.076054:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.076135:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+62:12382:x1874211953002624:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 328us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.076144:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 181 00000100:00100000:1.0:1787388131.076316:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953002752 00000100:00100000:1.0:1787388131.076327:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953002752 00000100:00100000:1.0:1787388131.076368:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:1.0:1787388131.076376:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+62:2403:x1874211953002752:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388131.076387:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388131.076403:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18126d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f13 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.076415:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388131.076418:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388131.076438:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+61:2403:x1874211953002752:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 62us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388131.076445:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:3.0:1787388131.078771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.079295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953003008 00000100:00100000:0.0:1787388131.079306:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953003008 00000100:00100000:0.0:1787388131.079490:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:0.0:1787388131.079502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+61:12382:x1874211953003008:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388131.079950:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+62:12382:x1874211953003008:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 449us (1185us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787388131.079959:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:3.0:1787388131.215669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.215844:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953003264 00000100:00100000:0.0:1787388131.215853:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953003264 00000100:00100000:0.0:1787388131.215937:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 182 00000100:00100000:0.0:1787388131.215949:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+62:12400:x1874211953003264:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:0.0:1787388131.215978:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388131.216003:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f1a expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.216128:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b18126f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.216144:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b18126f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.216156:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b18126f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388131.216169:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787388131.216297:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b18126ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f1a expref: 65 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.216317:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b18126f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f1a expref: 64 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.216325:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.216339:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787388131.216342:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa400, rc 0) 00000100:00100000:0.0:1787388131.216409:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+64:12400:x1874211953003264:12345-192.168.204.52@tcp:101:cat.0 Request processed in 462us (751us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787388131.216435:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 182 00000100:00100000:3.0:1787388131.241101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.241179:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953003392 00000100:00100000:2.0:1787388131.241190:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953003392 00000100:00100000:2.0:1787388131.241253:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 183 00000100:00100000:2.0:1787388131.241263:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+64:12401:x1874211953003392:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388131.241297:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388131.241320:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f21 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.241394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.241409:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.241421:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388131.241466:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787388131.241470:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388131.241501:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.241558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f21 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.241586:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f21 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.241595:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388131.241597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388131.241600:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709c00, rc 0) 00000100:00100000:2.0:1787388131.241663:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+65:12401:x1874211953003392:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 401us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.241671:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 183 00000100:00100000:3.0:1787388131.246229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.246317:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953003776 00000100:00100000:1.0:1787388131.246327:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953003776 00000100:00100000:1.0:1787388131.246491:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 48 00000100:00100000:1.0:1787388131.246502:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+65:12401:x1874211953003776:12345-192.168.204.52@tcp:35:lfs.0 00000001:00080000:1.0:1787388131.246772:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967459 00000100:00100000:1.0:1787388131.246928:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+67:12401:x1874211953003776:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 426us (707us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787388131.246935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 48 00000020:00080000:1.0:1787388131.246941:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388131.249583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.249714:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953003904 00000100:00100000:1.0:1787388131.249725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953003904 00000100:00100000:1.0:1787388131.249794:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:1.0:1787388131.249805:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+67:12401:x1874211953003904:12345-192.168.204.52@tcp:103:lfs.0 00010000:00010000:1.0:1787388131.249821:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787388131.249846:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b1812699 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f05 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.249898:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b18126f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f1a expref: 66 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.249912:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ebf expref: 65 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.249922:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:1.0:1787388131.249927:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388131.250019:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+64:12401:x1874211953003904:12345-192.168.204.52@tcp:103:lfs.0 Request processed in 215us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388131.250027:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:3.0:1787388131.251813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.251919:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953004032 00000100:00100000:2.0:1787388131.251927:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953004032 00000100:00100000:2.0:1787388131.251980:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 184 00000100:00100000:2.0:1787388131.251990:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+64:12401:x1874211953004032:12345-192.168.204.52@tcp:58:lfs.0 00010000:00010000:2.0:1787388131.252099:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.252115:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.252126:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388131.252222:0:13489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787388131.252299:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+64:12401:x1874211953004032:12345-192.168.204.52@tcp:58:lfs.0 Request processed in 310us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.252323:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 184 00000100:00100000:3.0:1787388131.277306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.277641:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953004160 00000100:00100000:0.0:1787388131.277651:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953004160 00000100:00100000:0.0:1787388131.277869:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 185 00000100:00100000:0.0:1787388131.277881:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+64:12403:x1874211953004160:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388131.277903:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388131.277924:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f28 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.277991:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278005:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278017:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278028:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278035:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278042:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278112:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278141:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278148:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388131.278192:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787388131.278196:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388131.278215:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278229:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278238:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278245:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278252:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278258:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.278263:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278270:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278283:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388131.278286:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.278297:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278305:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b181271e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278322:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278329:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278335:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278341:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.278344:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278350:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278359:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:0.0:1787388131.278361:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.278364:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278370:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278398:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 66 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278426:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 65 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.278433:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.278436:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388131.278438:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa400, rc 0) 00000100:00100000:0.0:1787388131.278510:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+65:12403:x1874211953004160:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 631us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.278519:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 185 00010000:00010000:0.0:1787388131.464397:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388131.655886:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388131.655899:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388131.655949:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787388131.655961:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388131.656102:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971939328:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388131.656211:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388131.665123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.665156:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953004288 00000100:00100000:0.0:1787388131.665165:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953004288 00000100:00100000:0.0:1787388131.665221:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 186 00000100:00100000:0.0:1787388131.665231:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953004288:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388131.665265:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388131.665410:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953004288:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 179us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.665418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 186 00000100:00100000:1.0:1787388131.665610:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971939328:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388131.677056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.677097:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953004416 00000100:00100000:0.0:1787388131.677107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953004416 00000100:00100000:0.0:1787388131.677161:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 187 00000100:00100000:0.0:1787388131.677171:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+65:12414:x1874211953004416:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787388131.677258:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677292:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677311:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677376:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677385:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677393:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677420:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677428:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677435:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388131.677501:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787388131.677506:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388131.677518:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677537:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677565:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677571:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677577:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.677582:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677589:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677601:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:0.0:1787388131.677604:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.677608:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677614:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb200/0x5cb77467b1812733 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677631:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677637:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677643:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677648:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.677657:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677664:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677672:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9273e13c5c00) 00010000:00010000:0.0:1787388131.677675:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.677710:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677723:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181273a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677739:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677744:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677750:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677760:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.677763:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677768:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677775:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.677778:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.677793:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.677799:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812741 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.677884:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+65:12414:x1874211953004416:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 Request processed in 706us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.677894:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 187 00000100:00100000:1.0:1787388131.685844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.685956:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953004672 00000100:00100000:3.0:1787388131.685967:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953004672 00000100:00100000:3.0:1787388131.686021:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 188 00000100:00100000:3.0:1787388131.686032:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+65:12414:x1874211953004672:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388131.686053:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388131.686079:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812748 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f2f expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686203:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686217:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686228:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388131.686240:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787388131.686423:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686439:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686445:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686515:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388131.686519:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686526:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686539:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388131.686542:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388131.686612:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686622:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181274f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686670:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812748 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f2f expref: 67 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686748:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:3.0:1787388131.686750:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388131.686755:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812748 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f2f expref: 67 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.686765:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496e00, rc 0) 00000100:00100000:3.0:1787388131.686837:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953004672:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 806us (1002us total) trans 4294967461 rc 301/301 00000100:00100000:3.0:1787388131.686846:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 188 00000100:00100000:0.0:1787388131.698737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.698972:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953004800 00000100:00100000:2.0:1787388131.698981:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953004800 00000100:00100000:2.0:1787388131.699041:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 189 00000100:00100000:2.0:1787388131.699051:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953004800:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388131.699094:0:13489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388131.699291:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953004800:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 240us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.699300:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 189 00000100:00100000:3.0:1787388131.706322:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.709769:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953005056 00000100:00100000:2.0:1787388131.709783:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953005056 00000100:00100000:2.0:1787388131.709866:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 190 00000100:00100000:2.0:1787388131.709877:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953005056:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388131.709897:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388131.709900:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388131.709925:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812709 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f21 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.709944:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388131.709949:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388131.709961:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181275d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f36 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388131.711616:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787388131.712436:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812764 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.712479:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.712490:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.712570:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181275d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f36 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.712587:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812764 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f36 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.712597:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc200) 00010000:00010000:2.0:1787388131.712599:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388131.712603:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709800, rc 0) 00000100:00100000:2.0:1787388131.712699:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+67:12414:x1874211953005056:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 2802us (6377us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787388131.712708:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 190 00000100:00100000:3.0:1787388131.717572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.717764:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953005312 00000100:00100000:2.0:1787388131.717787:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953005312 00000100:00100000:2.0:1787388131.717842:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 191 00000100:00100000:2.0:1787388131.717861:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+67:12414:x1874211953005312:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388131.717919:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388131.717959:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812764 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f36 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.717976:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc200) 00010000:00010000:2.0:1787388131.717996:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388131.718019:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718034:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718045:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718061:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718068:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718074:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718118:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718126:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718132:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718139:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.718143:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718151:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718167:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388131.718169:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.718173:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718180:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812772 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718190:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718195:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718201:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718206:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.718208:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718215:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718222:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fccb85c (ffff9273c39fc900) 00010000:00010000:2.0:1787388131.718225:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388131.718228:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.718233:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812779 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9fccb85c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.718318:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953005312:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 467us (753us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388131.718326:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 191 00000100:00100000:2.0:1787388131.722825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.722880:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953005440 00000100:00100000:2.0:1787388131.722891:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953005440 00000100:00100000:2.0:1787388131.722958:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 192 00000100:00100000:2.0:1787388131.722969:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+66:12414:x1874211953005440:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388131.722993:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388131.723020:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b1812780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f3d expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.723059:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.723075:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.723088:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.723207:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b1812780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 68 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.723223:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 67 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.723243:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:2.0:1787388131.723246:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388131.723250:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709c00, rc 0) 00000100:00100000:2.0:1787388131.723304:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+67:12414:x1874211953005440:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 337us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.723311:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 192 00000100:00100000:0.0:1787388131.732664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.733189:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953005696 00000100:00100000:1.0:1787388131.733201:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953005696 00000100:00100000:1.0:1787388131.733308:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 193 00000100:00100000:1.0:1787388131.733331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+67:12414:x1874211953005696:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787388131.733428:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.733460:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.733472:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388131.733642:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787388131.733656:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420717976086ns, next at 421717972436ns, rc = 0 00000004:00010000:1.0:1787388131.733733:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e3506ed7 reply state 000000005df40619 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.733747:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.733755:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:1.0:1787388131.733758:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787388131.733761:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388131.733890:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+69:12414:x1874211953005696:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 571us (1236us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1787388131.733898:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 193 00000100:00100000:3.0:1787388131.737208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.737328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953005824 00000100:00100000:3.0:1787388131.737339:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953005824 00000100:00100000:3.0:1787388131.737396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 194 00000100:00100000:3.0:1787388131.737408:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+69:12414:x1874211953005824:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388131.737433:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388131.737454:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f44 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.737517:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.737534:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.737555:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:3.0:1787388131.737559:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388131.737563:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496e00, rc 0) 00000100:00100000:3.0:1787388131.737620:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+70:12414:x1874211953005824:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 214us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388131.737628:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 194 00000100:00100000:3.0:1787388131.742968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.744488:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953005952 00000100:00100000:0.0:1787388131.744501:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953005952 00000100:00100000:0.0:1787388131.744560:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:0.0:1787388131.744571:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+6:2404:x1874211953005952:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787388131.744833:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953005952:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 263us (1874us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787388131.744841:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:3.0:1787388131.749424:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.750035:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953006208 00000100:00100000:2.0:1787388131.750044:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953006208 00000100:00100000:2.0:1787388131.750129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:2.0:1787388131.750139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+70:12414:x1874211953006208:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787388131.750364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+71:12414:x1874211953006208:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 225us (949us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1787388131.750372:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:3.0:1787388131.752462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.754731:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953006464 00000100:00100000:2.0:1787388131.754747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953006464 00000100:00100000:2.0:1787388131.754823:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 195 00000100:00100000:2.0:1787388131.754835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+71:12414:x1874211953006464:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787388131.755070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+71:12414:x1874211953006464:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 235us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.755078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 195 00000100:00100000:3.0:1787388131.761086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.761256:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953006592 00000100:00100000:1.0:1787388131.761265:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953006592 00000100:00100000:1.0:1787388131.761370:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 196 00000100:00100000:1.0:1787388131.761381:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+71:12414:x1874211953006592:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388131.761401:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388131.761419:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181279c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f4b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.761517:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18127a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.761531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18127a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.761542:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18127a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388131.761600:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388131.761620:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18127a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.761651:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b181279c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f4b expref: 73 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.761667:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18127a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f4b expref: 72 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.761675:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:1.0:1787388131.761698:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388131.761701:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4c00, rc 0) 00000100:00100000:1.0:1787388131.761767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+72:12414:x1874211953006592:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 388us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388131.761775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 196 00000100:00100000:3.0:1787388131.764396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.764515:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953006720 00000100:00100000:2.0:1787388131.764526:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953006720 00000100:00100000:2.0:1787388131.764590:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:2.0:1787388131.764603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211953006720:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388131.764652:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388131.764671:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f52 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388131.764717:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960e3, blocks: 0x0 00010000:00010000:2.0:1787388131.764737:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1787388131.764742:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388131.764752:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.764770:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.764783:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709600, rc 0) 00000100:00100000:2.0:1787388131.764847:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953006720:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 246us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.765777:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:3.0:1787388131.769376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.769462:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953006976 00000100:00100000:0.0:1787388131.769473:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953006976 00000100:00100000:0.0:1787388131.769537:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 197 00000100:00100000:0.0:1787388131.769557:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+72:12414:x1874211953006976:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787388131.769672:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+72:12414:x1874211953006976:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.769736:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 197 00000100:00100000:3.0:1787388131.773347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.773447:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953007104 00000100:00100000:0.0:1787388131.773457:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953007104 00000100:00100000:0.0:1787388131.773517:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:0.0:1787388131.773539:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+8:12414:x1874211953007104:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388131.773567:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388131.773583:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f59 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.773614:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.773624:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388131.773628:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388131.773633:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.773664:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.773711:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 9 pid: 8437 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.773727:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6862a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211971939456:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388131.773823:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388131.779710:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.779825:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953007232 00000100:00100000:2.0:1787388131.779835:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953007232 00010000:00010000:2.0:1787388131.779887:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 10 pid: 8437 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.779927:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 89 00000100:00100000:2.0:1787388131.779937:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+10:2404:x1874211953007232:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388131.779951:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388131.779979:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 10 pid: 8437 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.779994:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 10 pid: 8437 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.780022:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388131.780026:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388131.780035:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.780046:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.780087:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.780101:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874211971939584:192.168.204.52@tcp:105: 00000100:00100000:2.0:1787388131.780170:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c7d59180 going to sleep for 11 seconds 00010000:00010000:0.0:1787388131.780295:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b18127aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f52 expref: 10 pid: 8437 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.780309:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6862a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211971939456:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388131.780360:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.780371:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb600, rc 0) 00000100:00100000:0.0:1787388131.780399:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+9:12414:x1874211953007104:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 6862us (7061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.780406:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:2.0:1787388131.784136:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874211971939584:192.168.204.52@tcp:105: 00010000:00010000:2.0:1787388131.784168:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388131.784233:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211953007232:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 4296us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.784247:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 89 00000100:00100000:3.0:1787388131.787650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.787897:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953007360 00000100:00100000:0.0:1787388131.787909:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953007360 00002000:00100000:0.0:1787388131.787961:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9272c3f99500 x1874211953007360/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:387/0 lens 504/0 e 0 to 0 dl 1787388142 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388131.787971:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3f99500 with x1874211953007360 ext(0->8) 00002000:00010000:0.0:1787388131.787977:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3f99500 00000100:00100000:0.0:1787388131.788010:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:0.0:1787388131.788020:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953007360:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787388131.790888:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+10:2403:x1874211953007360:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 Request processed in 2858us (3233us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787388131.790904:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 5 00002000:00100000:0.0:1787388131.790915:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9272c3f99500 x1874211953007360/t4294967316(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:387/0 lens 504/448 e 0 to 0 dl 1787388142 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388131.790925:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c3f99500 with x1874211953007360 ext(0->8) 00002000:00010000:0.0:1787388131.790932:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c3f99500 00000100:00100000:3.0:1787388131.803036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388131.803119:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953007488 00000100:00100000:0.0:1787388131.803128:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953007488 00000100:00100000:0.0:1787388131.803204:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 198 00000100:00100000:0.0:1787388131.803213:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+72:12414:x1874211953007488:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388131.806513:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000004:00080000:3.0:1787388131.806529:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1787388131.806600:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787388131.806615:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9273c6bd0600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787388131.806620:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273fbe32100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9273c6bd0480 00000020:00080000:3.0:1787388131.806624:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273fbe32500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c3d41400 00000020:00080000:3.0:1787388131.806786:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787388131.806838:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787388131.806866:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971939712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787388131.806931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388131.806977:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388131.806983:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971939840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787388131.807005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388131.807045:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971939712 00000100:00100000:3.0:1787388131.807053:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971939712 00000100:00100000:3.0:1787388131.807099:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971939840 00000100:00100000:3.0:1787388131.807102:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971939840 00000100:00100000:3.0:1787388131.807123:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787388131.807131:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971939712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787388131.807240:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787388131.807244:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787388131 00002000:00010000:3.0:1787388131.807247:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787388131.807249:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787388131 -> 1787388131 00002000:00010000:3.0:1787388131.807252:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787388131.807289:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971939712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (357us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787388131.807297:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787388131.807313:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787388131.807319:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971939840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787388131.807334:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1787388131.807372:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8960e1, atime: 0x6a8960e1, ctime: 0x6a8960e1, blocks: 0x8 00010000:00010000:3.0:1787388131.807381:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.807395:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787388131.807399:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388131.807405:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.807419:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.807428:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.807446:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.807463:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787388131.807559:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1874211971939840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 239us (552us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787388131.807565:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787388131.807583:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388131.807588:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787388131.807621:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9273ffa85f80/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787388131.807627:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971939840:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787388131.807637:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9273ffa85500/2, rc 0, transno 4294967317 00000100:00100000:3.0:1787388131.807640:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971939712:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787388131.807741:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807750:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807756:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807763:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.807768:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807776:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807791:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9273da1a0000) 00010000:00010000:0.0:1787388131.807794:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.807799:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807805:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18124d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807824:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807831:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807858:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807864:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.807866:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807872:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807881:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388131.807883:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.807886:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807892:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18124e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807907:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807913:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807918:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807923:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.807926:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807943:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807953:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0c00) 00010000:00010000:0.0:1787388131.807956:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.807959:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807964:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181251f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807980:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807987:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807992:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.807997:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.808000:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808006:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808014:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.808016:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.808019:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808036:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b1812622 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808049:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808054:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808060:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808064:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.808067:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808072:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808080:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.808082:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.808084:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808089:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812645 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808099:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808104:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808115:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808119:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.808122:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808128:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808135:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.808137:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.808140:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808145:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b181268b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808157:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808163:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808168:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808172:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.808175:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808189:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808198:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:0.0:1787388131.808200:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787388131.808203:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808209:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b181278e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808232:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388131.808238:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808246:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388131.808249:0:10340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808256:0:10340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808268:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808276:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000995e3aef/0x5cb77467b18127b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.808301:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388131.808303:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388131.808305:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388131.808410:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+19:12414:x1874211953007488:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 Request processed in 5195us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.808418:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 198 00000100:00100000:1.0:1787388131.820936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.821473:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953007616 00000100:00100000:3.0:1787388131.821485:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953007616 00000100:00100000:3.0:1787388131.821559:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00100000:3.0:1787388131.821569:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+10:2404:x1874211953007616:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787388131.823223:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1787388131.823235:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:3.0:1787388131.826342:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953007616:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 Request processed in 4761us (5402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388131.826367:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00100000:3.0:1787388131.832425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.832485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953007872 00000100:00100000:1.0:1787388131.832495:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953007872 00000100:00100000:1.0:1787388131.832562:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 199 00000100:00100000:1.0:1787388131.832579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:12414:x1874211953007872:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787388131.832633:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388131.832659:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b18127a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f4b expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.832722:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:1.0:1787388131.832728:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388131.832758:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.832770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.832780:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388131.832910:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004607213 reply state 00000000c9c53b66 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.832923:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.832930:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:1.0:1787388131.832933:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388131.832936:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388131.833051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+20:12414:x1874211953007872:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 473us (742us total) trans 4294967465 rc 0/0 00000100:00100000:1.0:1787388131.833081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 199 00000100:00100000:3.0:1787388131.836615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.836672:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953008000 00000100:00100000:1.0:1787388131.836711:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953008000 00000100:00100000:1.0:1787388131.836769:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:1.0:1787388131.836793:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211953008000:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787388131.836973:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787388131.836977:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787388131 -> 1787388131 00002000:00010000:1.0:1787388131.836980:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787388129 00002000:00010000:1.0:1787388131.836983:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787388131 -> 1787388131 00002000:00010000:1.0:1787388131.836985:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787388131.837042:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953008000:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 264us (436us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787388131.837050:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:2.0:1787388131.840060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.840146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953008256 00000100:00100000:3.0:1787388131.840156:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953008256 00000100:00100000:3.0:1787388131.840289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 200 00000100:00100000:3.0:1787388131.840305:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+20:12414:x1874211953008256:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787388131.842751:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.842775:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 20 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.842784:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.842824:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 20 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.842839:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 20 pid: 13489 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388131.842866:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211971939968:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388131.843194:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388131.847331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.847498:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211971939968:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388131.847556:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.848937:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953008384 00000100:00100000:0.0:1787388131.848952:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953008384 00010000:00010000:0.0:1787388131.849005:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 21 pid: 13489 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.849045:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 90 00000100:00100000:0.0:1787388131.849055:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+21:2404:x1874211953008384:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388131.849073:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388131.849081:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 21 pid: 13489 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.849094:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 21 pid: 13489 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.849117:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f3d expref: 21 pid: 13489 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.849133:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:0.0:1787388131.849138:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.849162:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.849171:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.849205:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388131.849324:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+20:2404:x1874211953008384:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 269us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.849332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 90 00010000:00010000:2.0:1787388131.849398:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849407:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849464:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849472:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849479:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849485:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.849490:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849497:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849507:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:2.0:1787388131.849510:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787388131.849514:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.849520:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18127c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.849595:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+19:12414:x1874211953008256:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 Request processed in 9297us (9545us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787388131.849604:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 200 00000100:00100000:0.0:1787388131.858063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.861832:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953008512 00000100:00100000:2.0:1787388131.861856:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953008512 00000100:00100000:2.0:1787388131.861945:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:2.0:1787388131.861956:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211953008512:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787388131.862002:0:10361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.862023:0:10361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.862031:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388131.862035:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388131.862040:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.862078:0:10361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.862092:0:10361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 8 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.862109:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10361:1874211971940096:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388131.862212:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c7d599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388131.866130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.866746:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10361:1874211971940096:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388131.866774:0:10361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.867006:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953008640 00000100:00100000:0.0:1787388131.867014:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953008640 00010000:00010000:0.0:1787388131.867055:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.867094:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 91 00000100:00100000:0.0:1787388131.867105:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+9:2404:x1874211953008640:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388131.867121:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388131.867142:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.867155:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.867176:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa54d6b/0x5cb77467b18127b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f59 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.867209:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388131.867214:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388131.867220:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.867230:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.867267:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388131.867326:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+8:2404:x1874211953008640:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 222us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388131.867333:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 91 00010000:00010000:3.0:1787388131.867520:0:10361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867530:0:10361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867713:0:10361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867730:0:10361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867739:0:10361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867747:0:10361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388131.867752:0:10361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867761:0:10361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867774:0:10361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.867831:0:10361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091180ed2/0x5cb77467b18127cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388131.869109:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211953008512:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 Request processed in 7146us (11047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388131.869122:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:2.0:1787388131.892258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.893141:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953008896 00000100:00100000:3.0:1787388131.893152:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953008896 00000100:00100000:3.0:1787388131.893207:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 201 00000100:00100000:3.0:1787388131.893224:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+19:12414:x1874211953008896:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787388131.893302:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.893331:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 19 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.893342:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.894493:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 19 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.894511:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 19 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388131.894527:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971940224:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388131.894628:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388131.901922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.902052:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971940224:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388131.902083:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388131.902216:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953009024 00000100:00100000:3.0:1787388131.902223:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953009024 00010000:00010000:3.0:1787388131.902269:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 20 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388131.902309:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 92 00000100:00100000:3.0:1787388131.902328:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+20:2404:x1874211953009024:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388131.902353:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388131.902360:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 20 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.902374:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 20 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.902395:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b181261b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ee2 expref: 20 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.902415:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388131.902438:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.902451:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.902459:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.902499:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388131.902552:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+19:2404:x1874211953009024:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 234us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388131.902560:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 92 00010000:00010000:0.0:1787388131.902769:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.902778:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.902961:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.902974:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.902981:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.903034:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.903047:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 19 pid: 6520 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.903060:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2347480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971940352:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388131.903114:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388131.908310:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2347480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971940352:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388131.908364:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388131.913254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388131.913451:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953009152 00000100:00100000:1.0:1787388131.913462:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953009152 00010000:00010000:1.0:1787388131.913503:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 20 pid: 6520 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388131.913545:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 93 00000100:00100000:1.0:1787388131.913555:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+20:2404:x1874211953009152:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388131.913572:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388131.913579:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 20 pid: 6520 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.913592:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 20 pid: 6520 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.913613:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812795 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f44 expref: 20 pid: 6520 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.913627:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:1.0:1787388131.913633:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.913643:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.913650:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.913707:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388131.913769:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+19:2404:x1874211953009152:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 214us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388131.913777:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 93 00010000:00010000:3.0:1787388131.914250:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.914260:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388131.914528:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1787388131.914740:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000001:00080000:3.0:1787388131.914785:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1787388131.914912:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273eecfc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1874211971940480:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787388131.914999:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388131.915187:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971940480 00000100:00100000:1.0:1787388131.915195:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971940480 00000100:00100000:1.0:1787388131.915242:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787388131.915251:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9533:x1874211971940480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787388131.915333:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9533:x1874211971940480:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388131.915340:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787388131.915585:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2fa9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388131.915609:0:9533:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1787388131.915613:0:9533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9273ffa85500, transno 4294967317 00000100:00100000:2.0:1787388131.915633:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273eecfc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1874211971940480:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787388131.915794:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00000100:00100000:2.0:1787388131.915860:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1874211971940608:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787388131.915892:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388131.915909:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388131.915968:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971940608 00000100:00100000:1.0:1787388131.915972:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971940608 00000100:00100000:1.0:1787388131.916003:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787388131.916010:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9533:x1874211971940608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787388131.916118:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9533:x1874211971940608:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (224us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787388131.916124:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787388131.916254:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1874211971940608:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787388131.916285:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916295:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916303:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916336:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.916341:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916462:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916478:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:2.0:1787388131.916481:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388131.916486:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916492:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b18127db lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916516:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916523:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916529:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916533:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388131.916537:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916543:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916563:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:2.0:1787388131.916566:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388131.916569:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916575:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b1812710 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916596:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916610:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 22 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916620:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916646:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 22 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.916660:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 22 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388131.916673:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971940736:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388131.916762:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388131.920299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388131.920341:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953009280 00000100:00100000:3.0:1787388131.920356:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953009280 00010000:00010000:3.0:1787388131.920393:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 23 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388131.920444:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 94 00000100:00100000:3.0:1787388131.920454:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+23:2404:x1874211953009280:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388131.920470:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388131.920477:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 23 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.920490:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 23 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.920512:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:3.0:1787388131.920517:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.920527:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.920535:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388131.920553:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388131.920604:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+23:2404:x1874211953009280:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 151us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388131.920611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 94 00010000:00010000:0.0:1787388131.920832:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b181272c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f28 expref: 22 pid: 9533 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.920859:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971940736:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388131.920883:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920893:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920898:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920911:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920917:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920924:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920937:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.920941:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920949:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920959:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.920961:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388131.920964:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920970:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b18127e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920980:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920986:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920990:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.920994:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388131.920997:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.921002:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.921029:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273da1a0300) 00010000:00010000:0.0:1787388131.921031:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388131.921034:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388131.921040:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18127d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388131.921225:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+21:12414:x1874211953008896:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 28001us (28976us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787388131.921234:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 201 00000020:00080000:0.0:1787388131.921237:0:9533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787388131.922376:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388131.922383:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388131.922814:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787388131.922825:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388131.923361:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388131.923457:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953009536 00000100:00100000:2.0:1787388131.923467:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953009536 00000100:00100000:2.0:1787388131.923511:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:2.0:1787388131.923519:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+21:12414:x1874211953009536:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787388131.923873:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787388131.923910:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00010000:00010000:2.0:1787388131.923944:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.923961:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.923972:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.923981:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.923987:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.923993:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388131.924118:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787388131.924209:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+23:12414:x1874211953009536:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 689us (850us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787388131.924217:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 50 00000020:00080000:2.0:1787388131.924223:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787388131.926547:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388131.926561:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.926571:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388131.926576:0:7471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.926586:0:7471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.926616:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:1.0:1787388131.926619:0:7471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787388131.926624:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.926631:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708a00/0x5cb77467b18127e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388131.926643:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388131.926645:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388131.926646:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388132.037903:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388132.037913:0:14711:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388132.037936:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787388132.037945:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388132.126543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.127520:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953009792 00000100:00100000:3.0:1787388132.127540:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953009792 00000100:00100000:3.0:1787388132.127609:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 202 00000100:00100000:3.0:1787388132.127620:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+23:12425:x1874211953009792:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388132.127658:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388132.127699:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18127f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f60 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.127803:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18127f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.127819:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18127f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.127833:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18127f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388132.127855:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787388132.127965:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18127f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f60 expref: 26 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.127980:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18127f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f60 expref: 25 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.127989:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388132.127992:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388132.127995:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496400, rc 0) 00000100:00100000:3.0:1787388132.128066:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+25:12425:x1874211953009792:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 448us (1540us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787388132.128074:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 202 00000100:00100000:3.0:1787388132.130811:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.132779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953009920 00000100:00100000:0.0:1787388132.132799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953009920 00000100:00100000:0.0:1787388132.132914:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 203 00000100:00100000:0.0:1787388132.132928:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+25:12425:x1874211953009920:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:0.0:1787388132.133011:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133030:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133043:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133071:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133079:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133098:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133173:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133182:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133190:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388132.133310:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133323:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133329:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133336:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133342:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.133346:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133360:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133373:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388132.133376:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388132.133382:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133388:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812805 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133402:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133409:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133415:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133421:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.133423:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133429:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133436:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273e13c5100) 00010000:00010000:0.0:1787388132.133439:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388132.133441:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133457:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181280c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133474:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133480:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133499:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133504:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafbc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.133570:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133577:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133586:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273e13c5900) 00010000:00010000:0.0:1787388132.133592:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388132.133596:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.133602:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812813 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388132.133722:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+25:12425:x1874211953009920:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 795us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.133730:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 203 00000100:00100000:1.0:1787388132.169865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388132.170059:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953010176 00000100:00100000:2.0:1787388132.170069:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953010176 00000100:00100000:2.0:1787388132.170170:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 204 00000100:00100000:2.0:1787388132.170179:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+25:12428:x1874211953010176:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388132.170201:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388132.170224:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181281a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f67 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170315:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170333:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170344:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170359:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170367:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170374:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170514:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170536:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170544:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388132.170564:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787388132.170641:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170649:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170656:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170662:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.170666:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170674:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170715:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388132.170718:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.170723:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170729:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1812821 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170739:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170746:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170761:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170767:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.170770:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170777:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170786:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273c39fcb00) 00010000:00010000:2.0:1787388132.170788:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.170792:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170797:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170837:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181281a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 28 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170866:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 27 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.170875:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:2.0:1787388132.170877:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388132.170880:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708200, rc 0) 00000100:00100000:2.0:1787388132.170946:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+27:12428:x1874211953010176:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 766us (1088us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787388132.170962:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 204 00000100:00100000:3.0:1787388132.175065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.175506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953010304 00000100:00100000:0.0:1787388132.175515:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953010304 00000100:00100000:0.0:1787388132.175609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 205 00000100:00100000:0.0:1787388132.175620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+27:12428:x1874211953010304:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388132.175698:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175714:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175724:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175759:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175765:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175773:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175778:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.175783:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175790:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175801:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:0.0:1787388132.175804:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388132.175808:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.175821:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181283d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388132.175901:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+27:12428:x1874211953010304:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 283us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.175909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 205 00000100:00100000:0.0:1787388132.178623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388132.179278:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953010560 00000100:00100000:1.0:1787388132.179290:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953010560 00000100:00100000:1.0:1787388132.179357:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:1.0:1787388132.179369:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+27:12428:x1874211953010560:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388132.179615:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+28:12428:x1874211953010560:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 249us (997us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787388132.179624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:1.0:1787388132.211896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.211970:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953010816 00000100:00100000:3.0:1787388132.211989:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953010816 00000100:00100000:3.0:1787388132.212055:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 206 00000100:00100000:3.0:1787388132.212066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+28:11960:x1874211953010816:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388132.212096:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388132.212119:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812844 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.212232:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.212248:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.212257:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.212301:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.212330:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 29 pid: 9533 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.212356:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211971940864:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388132.212455:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388132.216073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.216107:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953010944 00000100:00100000:3.0:1787388132.216116:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953010944 00010000:00010000:3.0:1787388132.216157:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 30 pid: 9533 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.216206:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 95 00000100:00100000:3.0:1787388132.216216:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+30:2403:x1874211953010944:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388132.216234:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388132.216240:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 30 pid: 9533 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.216254:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 30 pid: 9533 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.216278:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.216284:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.216294:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.216301:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.216773:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388132.216823:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+30:2403:x1874211953010944:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 607us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388132.216831:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 95 00010000:00010000:3.0:1787388132.216990:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708200/0x5cb77467b181282f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f67 expref: 29 pid: 9533 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.217004:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211971940864:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388132.217032:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.217042:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.217048:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388132.217070:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787388132.217194:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812844 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.217208:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.217215:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.217218:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388132.217220:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496c00, rc 0) 00000100:00100000:3.0:1787388132.217295:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+29:11960:x1874211953010816:12345-192.168.204.52@tcp:101:bash.0 Request processed in 5231us (5410us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787388132.217302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 206 00000100:00100000:3.0:1787388132.219146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.219229:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953011072 00000100:00100000:0.0:1787388132.219239:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953011072 00000100:00100000:0.0:1787388132.219334:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 207 00000100:00100000:0.0:1787388132.219346:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+29:11960:x1874211953011072:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388132.219373:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.219392:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812859 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f75 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.219424:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812860 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.219437:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.219448:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.219560:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f75 expref: 31 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.219579:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812860 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f75 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.219595:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:0.0:1787388132.219597:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388132.219601:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa800, rc 0) 00000100:00100000:0.0:1787388132.219666:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+30:11960:x1874211953011072:12345-192.168.204.52@tcp:101:bash.0 Request processed in 322us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.219673:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 207 00000100:00100000:0.0:1787388132.223424:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.223546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953011328 00000100:00100000:3.0:1787388132.223556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953011328 00000100:00100000:3.0:1787388132.223614:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 208 00000100:00100000:3.0:1787388132.223624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+30:11960:x1874211953011328:12345-192.168.204.52@tcp:36:bash.0 00010000:00010000:3.0:1787388132.223897:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.223919:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.223931:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388132.223973:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000004:00010000:3.0:1787388132.223994:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034e473d2 reply state 0000000060fdffbf transno 4294967478 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.224006:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.224013:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.224016:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388132.224020:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787388132.224052:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967478 00000100:00100000:3.0:1787388132.224136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+34:11960:x1874211953011328:12345-192.168.204.52@tcp:36:bash.0 Request processed in 513us (723us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787388132.224144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 208 00000020:00080000:3.0:1787388132.224148:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787388132.228618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.228806:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953011456 00000100:00100000:3.0:1787388132.228818:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953011456 00000100:00100000:3.0:1787388132.228890:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 209 00000100:00100000:3.0:1787388132.228901:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+34:11960:x1874211953011456:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388132.228926:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388132.228948:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181286e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.229025:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181286e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f7c expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.229040:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181286e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f7c expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.229058:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.229062:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388132.229065:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497400, rc 0) 00000100:00100000:3.0:1787388132.229876:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+35:11960:x1874211953011456:12345-192.168.204.52@tcp:101:bash.0 Request processed in 972us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388132.229886:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 209 00000100:00100000:3.0:1787388132.233234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.233541:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953011584 00000100:00100000:0.0:1787388132.233550:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953011584 00000100:00100000:0.0:1787388132.233623:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:0.0:1787388132.233634:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+7:11960:x1874211953011584:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388132.233651:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.233671:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f83 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388132.233732:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8960e3, atime: 0x6a8960e1, ctime: 0x6a8960e3, blocks: 0x8 00010000:00010000:0.0:1787388132.233754:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1787388132.233757:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388132.233765:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.233782:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.233794:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb200, rc 0) 00000100:00100000:0.0:1787388132.233888:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+8:11960:x1874211953011584:12345-192.168.204.52@tcp:101:bash.0 Request processed in 255us (663us total) trans 0 rc 0/0 00000100:00080000:3.0:1787388132.233893:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388132.233898:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:0.0:1787388132.238988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.239241:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953011712 00000100:00100000:3.0:1787388132.239252:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953011712 00002000:00010000:3.0:1787388132.239300:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1787388132.239305:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273ffaf1c00 with x1874211953011712 ext(0->18446744073709551615) 00002000:00010000:3.0:1787388132.239327:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9273ffaf1c00. 00000100:00100000:3.0:1787388132.239422:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:3.0:1787388132.239434:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953011712:12345-192.168.204.52@tcp:10:bash.0 00002000:00010000:3.0:1787388132.240070:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787388132.240074:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787388131 -> 1787388132 00002000:00010000:3.0:1787388132.240077:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787388129 -> 1787388129 00002000:00010000:3.0:1787388132.240079:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787388131 -> 1787388132 00002000:00010000:3.0:1787388132.240092:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787388132.240157:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+9:2403:x1874211953011712:12345-192.168.204.52@tcp:10:bash.0 Request processed in 724us (1177us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787388132.240166:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 6 00002000:00010000:3.0:1787388132.240170:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1787388132.240173:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9273ffaf1c00 with x1874211953011712 ext(0->18446744073709551615) 00002000:00010000:3.0:1787388132.240179:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9273ffaf1c00. 00000100:00100000:0.0:1787388132.302506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388132.304261:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953011840 00000100:00100000:2.0:1787388132.304275:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953011840 00000100:00100000:2.0:1787388132.304357:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 210 00000100:00100000:2.0:1787388132.304368:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+35:12442:x1874211953011840:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:2.0:1787388132.304438:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304453:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304464:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304492:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304500:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304506:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304571:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304581:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304588:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388132.304651:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304664:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304671:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304720:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304727:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.304732:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304739:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304751:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388132.304755:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.304758:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304764:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b181287c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304776:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304787:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304800:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304805:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.304808:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304815:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304823:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273c39fcb00) 00010000:00010000:2.0:1787388132.304826:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.304829:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304836:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709a00/0x5cb77467b1812883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304862:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304868:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304874:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304879:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.304882:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304897:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304905:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:2.0:1787388132.304907:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.304910:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.304916:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b181288a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388132.304993:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+35:12442:x1874211953011840:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 626us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388132.305008:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 210 00000100:00100000:0.0:1787388132.346262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388132.346381:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953012096 00000100:00100000:1.0:1787388132.346390:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953012096 00000100:00100000:1.0:1787388132.346521:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 211 00000100:00100000:1.0:1787388132.346543:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+35:12445:x1874211953012096:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388132.346565:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388132.346587:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812891 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f8a expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346723:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346739:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346750:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346765:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346772:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346779:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346906:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18128a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346916:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18128a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.346934:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18128a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388132.346945:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787388132.347039:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347057:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347064:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347069:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388132.347073:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347080:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347094:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:1.0:1787388132.347096:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388132.347101:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347106:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812898 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347120:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347125:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347130:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347134:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388132.347143:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347150:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347159:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273d13bf400) 00010000:00010000:1.0:1787388132.347162:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388132.347164:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347170:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b181289f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347212:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812891 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f8a expref: 38 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347226:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18128a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f8a expref: 37 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.347233:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:1.0:1787388132.347235:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388132.347238:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4e00, rc 0) 00000100:00100000:1.0:1787388132.347292:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+37:12445:x1874211953012096:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 762us (1041us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787388132.347300:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 211 00000100:00100000:0.0:1787388132.354080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.354266:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953012224 00000100:00100000:3.0:1787388132.354276:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953012224 00000100:00100000:3.0:1787388132.354337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 212 00000100:00100000:3.0:1787388132.354348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+37:12445:x1874211953012224:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:3.0:1787388132.354417:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.354433:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.354448:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.354482:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.354496:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 37 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.354510:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211971940992:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388132.354606:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388132.358468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.358820:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211971940992:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388132.358866:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388132.358949:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953012480 00000100:00100000:2.0:1787388132.358956:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953012480 00000100:00100000:2.0:1787388132.359026:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:2.0:1787388132.359036:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d067ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+38:6171:x1874211953012480:12345-192.168.204.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787388132.359326:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d067ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+39:6171:x1874211953012480:12345-192.168.204.52@tcp:35:ldlm_bl.0 Request processed in 290us (866us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787388132.359334:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:3.0:1787388132.362174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388132.363115:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953012608 00000100:00100000:1.0:1787388132.363126:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953012608 00010000:00010000:1.0:1787388132.363183:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 39 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388132.364518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 96 00000100:00100000:1.0:1787388132.364535:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+39:2403:x1874211953012608:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388132.364554:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388132.364721:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 39 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.364738:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 39 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.364761:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b181284b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f6e expref: 39 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.364779:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:1.0:1787388132.364784:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.364794:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.364800:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.364871:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388132.364981:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+38:2403:x1874211953012608:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 452us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388132.364990:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 96 00010000:00010000:3.0:1787388132.365006:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365143:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365186:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365194:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365200:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365205:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388132.365209:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365216:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365226:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.365229:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388132.365233:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.365255:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.365294:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+37:12445:x1874211953012224:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 10949us (11225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388132.365505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 212 00000100:00100000:0.0:1787388132.370109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388132.370322:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953012864 00000100:00100000:2.0:1787388132.370332:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953012864 00000100:00100000:2.0:1787388132.370397:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:2.0:1787388132.370407:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+37:12445:x1874211953012864:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:2.0:1787388132.370791:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+38:12445:x1874211953012864:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 385us (692us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787388132.370816:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:0.0:1787388132.462857:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.463029:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953013120 00000100:00100000:3.0:1787388132.463040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953013120 00000100:00100000:3.0:1787388132.463156:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 213 00000100:00100000:3.0:1787388132.463169:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+38:12456:x1874211953013120:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:3.0:1787388132.463197:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388132.463221:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f91 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463300:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463315:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463326:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463341:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463348:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463373:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463492:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18128d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463501:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18128d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463508:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18128d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388132.463518:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787388132.463595:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463602:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463608:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463614:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388132.463619:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463625:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463637:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388132.463639:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388132.463649:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463655:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463669:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463675:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463739:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463744:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388132.463747:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463751:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463760:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:3.0:1787388132.463762:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388132.463764:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463769:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463812:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f91 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463849:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18128d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f91 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.463857:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.463860:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388132.463862:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:3.0:1787388132.463942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+40:12456:x1874211953013120:12345-192.168.204.52@tcp:101:cat.0 Request processed in 775us (1106us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787388132.463950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 213 00000100:00100000:3.0:1787388132.468917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388132.469227:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953013376 00000100:00100000:1.0:1787388132.469252:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953013376 00000100:00100000:1.0:1787388132.469350:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:1.0:1787388132.469372:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+40:12456:x1874211953013376:12345-192.168.204.52@tcp:35:cat.0 00000100:00100000:1.0:1787388132.469658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+41:12456:x1874211953013376:12345-192.168.204.52@tcp:35:cat.0 Request processed in 287us (762us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787388132.469671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 54 00010000:00010000:3.0:1787388132.493861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388132.493988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.494127:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953013632 00000100:00100000:3.0:1787388132.494136:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953013632 00000100:00100000:3.0:1787388132.494205:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 214 00000100:00100000:3.0:1787388132.494215:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+41:12457:x1874211953013632:12345-192.168.204.52@tcp:36:rm.0 00010000:00010000:3.0:1787388132.494274:0:13489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787388132.494300:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b181286e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f7c expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494334:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18128d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f91 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494349:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18128a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f8a expref: 39 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494756:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812860 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f75 expref: 38 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494784:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.494789:0:13489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388132.494812:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494825:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494845:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494861:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494869:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494876:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494959:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494968:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.494976:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388132.495194:0:13489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:3.0:1787388132.495244:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495260:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495268:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495275:0:13489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495281:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495287:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495465:0:13489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388132.495487:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495495:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495501:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495507:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388132.495512:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495520:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495541:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:3.0:1787388132.495544:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787388132.495548:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495555:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b18128ec lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495571:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495578:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495584:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495590:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388132.495593:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495599:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495607:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388132.495609:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388132.495612:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495618:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18128de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388132.495651:0:13489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abc18c62 reply state 000000009f56cf6f transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495663:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.495669:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:3.0:1787388132.495671:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388132.495674:0:13489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388132.495770:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+39:12457:x1874211953013632:12345-192.168.204.52@tcp:36:rm.0 Request processed in 1555us (1787us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787388132.495780:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 214 00010000:00010000:2.0:1787388132.497103:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388132.497117:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.497128:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388132.497132:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.497202:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.497219:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:2.0:1787388132.497222:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787388132.497227:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.497232:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b18128f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.497245:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388132.497247:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388132.497249:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388132.530514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.530602:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953013888 00000100:00100000:3.0:1787388132.530612:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953013888 00000100:00100000:3.0:1787388132.530812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 215 00000100:00100000:0.0:1787388132.530901:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+39:12463:x1874211953013888:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388132.530928:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.530950:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18128fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531052:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531067:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531078:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531090:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531097:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531122:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388132.531592:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787388132.531761:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531772:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531780:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531813:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531821:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531828:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531845:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafba00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.531849:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531858:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531871:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388132.531874:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388132.531886:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531893:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812901 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388132.531909:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8a72111 reply state 0000000073c65abb transno 4294967486 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531921:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531928:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:0.0:1787388132.531930:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388132.531933:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787388132.531960:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b18128fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531975:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.531983:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:0.0:1787388132.531985:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388132.531987:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafb600, rc 0) 00000100:00100000:0.0:1787388132.532049:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+42:12463:x1874211953013888:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1226us (1542us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787388132.533116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 215 00000100:00100000:0.0:1787388132.535552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.535651:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953014016 00000100:00100000:3.0:1787388132.535660:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953014016 00000100:00100000:3.0:1787388132.535849:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 70 00000100:00100000:3.0:1787388132.535860:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2402:x1874211953014016:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388132.535878:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388132.535901:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4f9f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388132.535927:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388132.535945:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787388132.535950:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388132.535959:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.535993:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.536006:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496000, rc 0) 00000100:00100000:3.0:1787388132.536061:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2402:x1874211953014016:12345-192.168.204.52@tcp:101:bash.0 Request processed in 202us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388132.536069:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 70 00000100:00080000:2.0:1787388132.536940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388132.538939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388132.539020:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953014144 00000100:00100000:1.0:1787388132.539030:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953014144 00000100:00100000:1.0:1787388132.539085:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:1.0:1787388132.539096:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:12463:x1874211953014144:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:1.0:1787388132.539113:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388132.539131:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fa6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.539176:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.539186:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388132.539190:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388132.539196:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.539230:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.539245:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388132.539272:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874211971941120:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388132.539607:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388132.541862:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874211971941120:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388132.541897:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.541920:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4c00, rc 0) 00000100:00100000:3.0:1787388132.541983:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+9:12463:x1874211953014144:12345-192.168.204.52@tcp:101:bash.0 Request processed in 2889us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388132.541992:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 71 00000100:00100000:2.0:1787388132.544584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.544908:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953014272 00000100:00100000:3.0:1787388132.544919:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953014272 00010000:00010000:3.0:1787388132.544958:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.545041:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 97 00000100:00100000:3.0:1787388132.545052:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+9:2403:x1874211953014272:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388132.545067:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388132.545103:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.545119:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.545156:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b181291d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f9f expref: 9 pid: 8437 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.545173:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388132.545177:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388132.545186:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.545196:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.545234:0:7461:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.545250:0:7461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7461:1874211971941248:192.168.204.52@tcp:105: 00000100:00100000:3.0:1787388132.545346:0:7461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388132.547870:0:7461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7461:1874211971941248:192.168.204.52@tcp:105: 00010000:00010000:1.0:1787388132.547902:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388132.547958:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953014272:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 2907us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388132.547968:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 97 00000100:00100000:1.0:1787388132.550360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.550486:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953014528 00000100:00100000:3.0:1787388132.550496:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953014528 00000100:00100000:3.0:1787388132.550553:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:3.0:1787388132.550562:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+42:12463:x1874211953014528:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:3.0:1787388132.550922:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+43:12463:x1874211953014528:12345-192.168.204.52@tcp:35:bash.0 Request processed in 360us (577us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1787388132.550930:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:3.0:1787388132.696347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.698105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953014656 00000100:00100000:0.0:1787388132.698120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953014656 00000100:00100000:0.0:1787388132.698290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 216 00000100:00100000:0.0:1787388132.698302:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+43:12479:x1874211953014656:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388132.698327:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.698358:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181292b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.698426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.698442:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.698453:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388132.698500:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787388132.698504:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388132.698534:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.698563:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181292b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fad expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.698585:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fad expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.698593:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388132.698596:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388132.698599:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafba00, rc 0) 00000100:00100000:0.0:1787388132.698673:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+44:12479:x1874211953014656:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 374us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.698745:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 216 00000100:00100000:2.0:1787388132.708065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.708187:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953014912 00000100:00100000:3.0:1787388132.708196:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953014912 00000100:00100000:3.0:1787388132.708267:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 217 00000100:00100000:3.0:1787388132.708277:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+44:12479:x1874211953014912:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388132.708308:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388132.708331:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812939 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fb4 expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.708456:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.708471:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.708483:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388132.708494:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787388132.708604:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812939 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fb4 expref: 47 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.708623:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fb4 expref: 46 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.708650:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:3.0:1787388132.708653:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388132.708656:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496200, rc 0) 00000100:00100000:3.0:1787388132.709874:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+46:12479:x1874211953014912:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1588us (1809us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1787388132.709885:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 217 00000100:00100000:2.0:1787388132.715891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.716028:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953015040 00000100:00100000:0.0:1787388132.716039:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953015040 00000100:00100000:0.0:1787388132.716122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:0.0:1787388132.716134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+46:2401:x1874211953015040:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388132.716150:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388132.716176:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fb4 expref: 46 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.716196:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:0.0:1787388132.716212:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388132.716278:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+45:2401:x1874211953015040:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 145us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.716285:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:2.0:1787388132.719594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.719716:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953015296 00000100:00100000:0.0:1787388132.719727:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953015296 00000100:00100000:0.0:1787388132.719781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 218 00000100:00100000:0.0:1787388132.719791:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+45:12479:x1874211953015296:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388132.719814:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.719843:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181294e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fbb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.719961:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812955 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.719976:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812955 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.720002:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812955 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388132.720015:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787388132.720336:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181294e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fbb expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.720359:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812955 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fbb expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.720369:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:0.0:1787388132.720372:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787388132.720376:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa800, rc 0) 00000100:00100000:0.0:1787388132.720493:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+47:12479:x1874211953015296:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 702us (907us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1787388132.720502:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 218 00000100:00100000:2.0:1787388132.729255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.729538:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953015424 00000100:00100000:3.0:1787388132.729549:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953015424 00000100:00100000:3.0:1787388132.730757:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:3.0:1787388132.730772:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2402:x1874211953015424:12345-192.168.204.52@tcp:1:lfs.0 00010000:00010000:3.0:1787388132.730891:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.730920:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.730930:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388132.730935:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388132.730939:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.730978:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.730992:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 8 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.731022:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211971941376:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388132.731125:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388132.736398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.736990:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211971941376:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388132.737019:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388132.742034:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953015552 00000100:00100000:0.0:1787388132.742049:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953015552 00002000:00100000:0.0:1787388132.742106:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9272c209c000 x1874211953015552/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:388/0 lens 504/0 e 0 to 0 dl 1787388143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388132.742118:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c209c000 with x1874211953015552 ext(0->8) 00010000:00010000:0.0:1787388132.742127:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.742144:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388132.742173:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9272c209c000 00000100:00100000:0.0:1787388132.742199:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:0.0:1787388132.742208:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+9:2403:x1874211953015552:12345-192.168.204.52@tcp:4:lfs.0 00000100:00100000:0.0:1787388132.743201:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+11:2403:x1874211953015552:12345-192.168.204.52@tcp:4:lfs.0 Request processed in 986us (6808us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787388132.743212:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00002000:00100000:0.0:1787388132.743221:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9272c209c000 x1874211953015552/t4294967309(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:388/0 lens 504/448 e 0 to 0 dl 1787388143 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388132.743230:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c209c000 with x1874211953015552 ext(0->8) 00010000:00010000:0.0:1787388132.743237:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 11 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.743252:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 11 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388132.743260:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9272c209c000 00000100:00100000:2.0:1787388132.749581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.750956:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953015680 00000100:00100000:3.0:1787388132.750970:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953015680 00010000:00010000:3.0:1787388132.751021:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 11 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.751132:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 98 00000100:00100000:3.0:1787388132.751144:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+11:2404:x1874211953015680:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388132.751161:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787388132.751179:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787388132.751182:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787388132 00002000:00010000:3.0:1787388132.751184:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787388132 00002000:00010000:3.0:1787388132.751187:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787388132 00002000:00010000:3.0:1787388132.751189:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787388132.751195:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 11 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.751211:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 11 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.751256:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbf55313/0x5cb77467b1812924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fa6 expref: 11 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.751274:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388132.751279:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388132.751284:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.751294:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.751759:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388132.751847:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+10:2404:x1874211953015680:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 704us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388132.751857:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 98 00010000:00010000:2.0:1787388132.751927:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.751938:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.751960:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.751969:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.751977:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.751984:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388132.751988:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.751998:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.752013:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.752030:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b828eb/0x5cb77467b1812963 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388132.752086:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273eecfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+9:2402:x1874211953015424:12345-192.168.204.52@tcp:1:lfs.0 Request processed in 21317us (23276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388132.752095:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 72 00000100:00100000:2.0:1787388132.755266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388132.755894:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953015936 00000100:00100000:3.0:1787388132.755905:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953015936 00000100:00100000:3.0:1787388132.755951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:3.0:1787388132.755960:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+47:12479:x1874211953015936:12345-192.168.204.52@tcp:35:lfs.0 00000004:00010000:3.0:1787388132.756026:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812955 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fbb expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388132.756217:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1787388132.756254:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1787388132.757041:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787388132.757085:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.757109:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.757118:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.757153:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388132.757168:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 51 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.757184:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874211971941504:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388132.757276:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388132.760239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.760354:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953016064 00000100:00100000:0.0:1787388132.760364:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953016064 00010000:00010000:0.0:1787388132.760405:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 52 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388132.760457:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 99 00000100:00100000:0.0:1787388132.760467:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+52:2403:x1874211953016064:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388132.760515:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388132.760523:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 52 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.760537:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 52 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.760560:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:0.0:1787388132.760566:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.760576:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.760583:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.760604:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388132.760666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+52:2403:x1874211953016064:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 200us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.760674:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 99 00010000:00010000:3.0:1787388132.761959:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181290f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f98 expref: 51 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388132.762213:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874211971941504:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388132.762236:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.762973:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.762985:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388132.763109:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000001:00080000:2.0:1787388132.765950:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1787388132.766160:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971941632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787388132.766225:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388132.766265:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787388132.766368:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971941632 00000100:00100000:1.0:1787388132.766376:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971941632 00000100:00100000:1.0:1787388132.766443:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787388132.766453:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874211971941632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787388132.766563:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874211971941632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388132.766571:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787388132.767605:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971941632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787388132.767775:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000100:00100000:2.0:1787388132.767847:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971941760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787388132.767893:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388132.767920:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388132.767929:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971941760 00000100:00100000:3.0:1787388132.767936:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971941760 00000100:00100000:3.0:1787388132.767978:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787388132.767986:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1874211971941760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787388132.768112:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6524:x1874211971941760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (218us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787388132.768133:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787388132.768637:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874211971941760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787388132.768720:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1787388132.768773:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.768784:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.768791:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.768796:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.768801:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.768807:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.768823:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:2.0:1787388132.768827:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787388132.768844:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.768851:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b181296a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388132.768946:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787388132.769009:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787388132.769022:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421753342013ns, next at 422753338873ns, rc = 0 00000001:00080000:2.0:1787388132.769028:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00010000:00010000:2.0:1787388132.769052:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5600) 00010000:00010000:2.0:1787388132.769055:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787388132.769062:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b1812955 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fbb expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388132.769176:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+54:12479:x1874211953015936:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 13216us (13918us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787388132.769185:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 56 00000020:00080000:2.0:1787388132.769189:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787388132.772723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.772768:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953016192 00000100:00100000:0.0:1787388132.772779:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953016192 00000100:00100000:0.0:1787388132.772851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 219 00000100:00100000:0.0:1787388132.772863:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+54:12479:x1874211953016192:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388132.772884:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.772908:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812971 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fc2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.772982:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc2 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.772996:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc2 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.773015:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388132.773019:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388132.773022:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafbc00, rc 0) 00000100:00100000:0.0:1787388132.773093:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+55:12479:x1874211953016192:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 232us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.773101:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 219 00000100:00100000:0.0:1787388132.779748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388132.779846:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953016448 00000100:00100000:1.0:1787388132.779856:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953016448 00000100:00100000:1.0:1787388132.779975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:1.0:1787388132.779986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+55:12479:x1874211953016448:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388132.780220:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+56:12479:x1874211953016448:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 235us (479us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787388132.780227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 57 00000004:00080000:2.0:1787388132.871910:0:8464:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421856226748ns, next at 422856223856ns, rc = 0 00000100:00100000:1.0:1787388132.873131:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388132.873156:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971941888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388132.873223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388132.876140:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971941888 00000100:00100000:0.0:1787388132.876160:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971941888 00000100:00100000:0.0:1787388132.876241:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787388132.876252:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971941888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388132.876280:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787388132.876359:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874211971941888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.876366:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787388132.878166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971942016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388132.878225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388132.878301:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971941888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388132.878825:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971942016 00000100:00100000:2.0:1787388132.878842:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971942016 00000100:00100000:2.0:1787388132.878905:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787388132.878915:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971942016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388132.878934:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787388132.878980:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971942016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388132.878987:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787388132.879108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971942016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388132.879165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00080000:3.0:1787388132.879236:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388132.879282:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953016576 00000100:00100000:2.0:1787388132.879286:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953016576 00000100:00100000:2.0:1787388132.879319:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 220 00000100:00100000:2.0:1787388132.879327:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+56:12489:x1874211953016576:12345-192.168.204.52@tcp:34:lfs.0 00010000:00010000:2.0:1787388132.879404:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879423:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879435:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879447:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879469:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879477:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879565:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879574:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879581:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388132.879632:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879645:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879651:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879657:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879664:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.879668:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879675:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879724:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388132.879727:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.879732:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879738:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1812978 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879751:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879757:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879762:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879766:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.879769:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879775:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879781:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:2.0:1787388132.879783:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.879786:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879792:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b181297f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879811:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879817:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879822:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879846:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388132.879849:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879854:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879862:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388132.879864:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388132.879867:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388132.879872:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709600/0x5cb77467b1812986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388132.880160:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+56:12489:x1874211953016576:12345-192.168.204.52@tcp:34:lfs.0 Request processed in 830us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388132.880169:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 220 00000100:00100000:3.0:1787388132.946925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.947060:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953016832 00000100:00100000:0.0:1787388132.947070:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953016832 00000100:00100000:0.0:1787388132.947195:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 221 00000100:00100000:0.0:1787388132.947206:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+56:12492:x1874211953016832:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388132.947245:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388132.947266:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181298d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fc9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947554:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947572:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947585:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947598:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947606:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947613:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947796:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947805:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947812:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388132.947823:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787388132.947921:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947929:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947934:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947940:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.947944:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947951:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947962:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388132.947965:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388132.947971:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947977:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa400/0x5cb77467b1812994 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947992:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.947999:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948005:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948011:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafb400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.948020:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948027:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948035:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:0.0:1787388132.948038:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388132.948041:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948047:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb400/0x5cb77467b181299b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948092:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafb600/0x5cb77467b181298d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948106:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.948114:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388132.948116:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388132.948119:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273dfafa800, rc 0) 00000100:00100000:0.0:1787388132.948197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+58:12492:x1874211953016832:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 993us (1283us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787388132.948207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 221 00000100:00100000:3.0:1787388132.952661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.952787:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953016960 00000100:00100000:0.0:1787388132.952799:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953016960 00000100:00100000:0.0:1787388132.952875:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 222 00000100:00100000:0.0:1787388132.952887:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+58:12492:x1874211953016960:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:0.0:1787388132.952985:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953003:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953016:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953057:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953064:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953070:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953076:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388132.953080:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953088:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953100:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388132.953104:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388132.953108:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388132.953114:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b18129b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388132.953195:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+58:12492:x1874211953016960:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 310us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.953202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 222 00000100:00100000:2.0:1787388132.956791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388132.956926:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953017216 00000100:00100000:0.0:1787388132.956936:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953017216 00000100:00100000:0.0:1787388132.956985:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:0.0:1787388132.956996:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+58:12492:x1874211953017216:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388132.957237:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+59:12492:x1874211953017216:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 242us (455us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787388132.957246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:3.0:1787388133.047180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388133.047307:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953017472 00000100:00100000:1.0:1787388133.047318:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953017472 00000100:00100000:1.0:1787388133.047427:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 223 00000100:00100000:1.0:1787388133.047439:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+59:12502:x1874211953017472:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:1.0:1787388133.047472:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388133.047476:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787388133.047505:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafba00/0x5cb77467b1812932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fad expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.047838:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:1.0:1787388133.047844:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388133.047861:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18129b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fd0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.047971:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.047985:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.048016:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.048048:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.048061:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 59 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388133.048074:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971942144:192.168.204.52@tcp:104: 00000100:00080000:3.0:1787388133.048174:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388133.048248:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388133.053318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388133.053441:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971942144:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388133.053473:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388133.053596:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953017600 00000100:00100000:3.0:1787388133.053603:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953017600 00010000:00010000:3.0:1787388133.053639:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 60 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388133.053722:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 100 00000100:00100000:3.0:1787388133.053733:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+60:2404:x1874211953017600:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388133.053748:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388133.053755:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 60 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.053768:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 60 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.053792:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa800/0x5cb77467b18129a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc9 expref: 60 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.053810:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388133.053815:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.053862:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.053871:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.053896:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388133.053946:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74df45bd-a066-4da5-9401-b0a043132784+59:2404:x1874211953017600:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 215us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388133.053954:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 100 00010000:00010000:1.0:1787388133.054035:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.054044:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388133.054062:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787388133.054188:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b18129b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 60 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.054203:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 59 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.054222:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388133.054225:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388133.054228:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4e00, rc 0) 00000100:00100000:1.0:1787388133.054254:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+59:12502:x1874211953017472:12345-192.168.204.52@tcp:101:bash.0 Request processed in 6818us (7084us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787388133.054261:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 223 00000100:00100000:0.0:1787388133.063948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388133.064346:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953017728 00000100:00100000:3.0:1787388133.064357:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953017728 00000100:00100000:3.0:1787388133.064420:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 224 00000100:00100000:3.0:1787388133.064431:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+59:12502:x1874211953017728:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388133.064456:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388133.064476:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18129cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fd7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.064512:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.064528:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.064539:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.064656:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18129cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.064799:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.064809:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388133.064812:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388133.064815:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497e00, rc 0) 00000100:00100000:3.0:1787388133.064948:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+60:12502:x1874211953017728:12345-192.168.204.52@tcp:101:bash.0 Request processed in 518us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388133.064956:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 224 00000100:00100000:0.0:1787388133.071122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388133.071390:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953017984 00000100:00100000:2.0:1787388133.071400:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953017984 00000100:00100000:2.0:1787388133.071489:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 225 00000100:00100000:2.0:1787388133.071499:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+60:12502:x1874211953017984:12345-192.168.204.52@tcp:36:bash.0 00010000:00010000:2.0:1787388133.071984:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.072003:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.072014:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388133.072058:0:13489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00000004:00010000:2.0:1787388133.072081:0:13489:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d237c597 reply state 000000005b5c7978 transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.072096:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.072103:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388133.072106:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388133.072109:0:13489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388133.073855:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+63:12502:x1874211953017984:12345-192.168.204.52@tcp:36:bash.0 Request processed in 2347us (2733us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787388133.073869:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 225 00000020:00080000:2.0:1787388133.073877:0:13489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787388133.083360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388133.083808:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953018112 00000100:00100000:0.0:1787388133.083818:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953018112 00000100:00100000:0.0:1787388133.083893:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 226 00000100:00100000:0.0:1787388133.083904:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+63:12502:x1874211953018112:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:0.0:1787388133.083927:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388133.083949:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18129e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fde expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.084047:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.084065:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 64 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.084096:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.084134:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 64 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.084148:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 64 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388133.084162:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971942272:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388133.084330:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388133.089659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388133.089783:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953018240 00000100:00100000:2.0:1787388133.089794:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953018240 00010000:00010000:2.0:1787388133.089851:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 65 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388133.089890:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 101 00000100:00100000:2.0:1787388133.089921:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+65:2404:x1874211953018240:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388133.089938:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388133.089946:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 65 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.089962:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 65 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.089991:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388133.089997:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.090009:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.090017:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.090039:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388133.090108:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+65:2404:x1874211953018240:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 190us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388133.090116:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 101 00010000:00010000:1.0:1787388133.090216:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b18129be lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd0 expref: 64 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388133.090238:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971942272:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388133.090260:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.090270:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.090277:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388133.090466:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787388133.090471:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388133.090790:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.090837:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b18129e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 64 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.090870:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 63 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.090878:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388133.090881:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388133.090884:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:1.0:1787388133.090923:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+63:12502:x1874211953018112:12345-192.168.204.52@tcp:101:bash.0 Request processed in 7021us (7573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388133.090931:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 226 00000100:00100000:0.0:1787388133.096929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388133.097709:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953018496 00000100:00100000:2.0:1787388133.097721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953018496 00000100:00100000:2.0:1787388133.097778:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:2.0:1787388133.097789:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+63:12502:x1874211953018496:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:2.0:1787388133.098148:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+64:12502:x1874211953018496:12345-192.168.204.52@tcp:35:bash.0 Request processed in 359us (1229us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787388133.098174:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:0.0:1787388133.184067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388133.184162:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953018624 00000100:00100000:3.0:1787388133.184173:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953018624 00000100:00100000:3.0:1787388133.184233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 227 00000100:00100000:3.0:1787388133.184243:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+64:12508:x1874211953018624:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388133.184269:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388133.184290:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18129ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fe5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.184354:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18129f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.184368:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18129f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.184380:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18129f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388133.184421:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787388133.184436:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388133.184456:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18129f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.184490:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b18129ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fe5 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.184508:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18129f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fe5 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.184516:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388133.184519:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388133.184523:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:3.0:1787388133.184583:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953018624:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 341us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388133.184590:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 227 00000100:00100000:0.0:1787388133.199734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388133.199852:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953018752 00000100:00100000:2.0:1787388133.199863:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953018752 00000100:00100000:2.0:1787388133.199940:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 228 00000100:00100000:2.0:1787388133.199951:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953018752:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:2.0:1787388133.199974:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388133.200013:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18129fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4fec expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200082:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200097:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200108:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200118:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200126:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200133:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200208:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200236:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200243:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388133.200290:0:13489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787388133.200295:0:13489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388133.200315:0:13489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200326:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200335:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200341:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200347:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200352:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388133.200357:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200364:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200376:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:2.0:1787388133.200385:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388133.200391:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200397:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709e00/0x5cb77467b1812a04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200411:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200417:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200423:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200428:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388133.200431:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200436:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200444:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:2.0:1787388133.200446:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388133.200449:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200455:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200929:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b18129fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fec expref: 67 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200962:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fec expref: 66 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.200970:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388133.200973:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388133.200975:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709800, rc 0) 00000100:00100000:2.0:1787388133.201050:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+66:12508:x1874211953018752:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1100us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388133.201058:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 228 00000100:00100000:0.0:1787388133.208529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388133.208643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953018880 00000100:00100000:2.0:1787388133.208653:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953018880 00000100:00100000:2.0:1787388133.208736:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:2.0:1787388133.208748:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+66:2404:x1874211953018880:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388133.208765:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388133.208790:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709800/0x5cb77467b1812a12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fec expref: 66 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.208810:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388133.208815:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388133.208885:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+65:2404:x1874211953018880:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 140us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388133.208892:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:0.0:1787388133.211122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388133.211258:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953019136 00000100:00100000:1.0:1787388133.211270:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953019136 00000100:00100000:1.0:1787388133.211328:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 229 00000100:00100000:1.0:1787388133.211339:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953019136:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388133.211363:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388133.211386:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ff3 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.211508:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.211524:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 66 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.211532:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.211570:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 66 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.211601:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 66 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388133.211620:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971942400:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388133.211754:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388133.214947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388133.215017:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953019264 00000100:00100000:3.0:1787388133.215025:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953019264 00010000:00010000:3.0:1787388133.215060:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 67 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388133.215099:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 102 00000100:00100000:3.0:1787388133.215108:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+67:2404:x1874211953019264:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388133.215122:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388133.215128:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 67 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.215140:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 67 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.215176:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388133.215181:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.215191:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.215199:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.215216:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388133.215266:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+67:2404:x1874211953019264:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 159us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388133.215273:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 102 00010000:00010000:1.0:1787388133.215970:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b18129e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fde expref: 66 pid: 9533 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388133.216249:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1874211971942400:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388133.216275:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.216286:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.216293:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388133.216313:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787388133.216443:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 67 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.216459:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 66 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.216468:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388133.216555:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388133.216559:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273e76b4c00, rc 0) 00000100:00100000:1.0:1787388133.216665:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+66:12508:x1874211953019136:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 5326us (5553us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787388133.216674:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 229 00000100:00100000:0.0:1787388133.224808:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388133.226192:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953019520 00000100:00100000:2.0:1787388133.226205:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953019520 00000100:00100000:2.0:1787388133.226296:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:2.0:1787388133.226326:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+66:12508:x1874211953019520:12345-192.168.204.52@tcp:103:lfs.0 00010000:00010000:2.0:1787388133.226354:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388133.226380:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafbc00/0x5cb77467b1812971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fc2 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388133.226403:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388133.226409:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388133.226583:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953019520:12345-192.168.204.52@tcp:103:lfs.0 Request processed in 259us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388133.226591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:0.0:1787388133.233409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388133.233514:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953019648 00000100:00100000:1.0:1787388133.233524:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953019648 00000100:00100000:1.0:1787388133.233587:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 230 00000100:00100000:1.0:1787388133.233598:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953019648:12345-192.168.204.52@tcp:58:lfs.0 00010000:00010000:1.0:1787388133.233752:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.233770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388133.233781:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388133.233893:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787388133.233980:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953019648:12345-192.168.204.52@tcp:58:lfs.0 Request processed in 383us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388133.233989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 230 00000100:00100000:0.0:1787388133.242068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388133.242794:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953019776 00000100:00100000:3.0:1787388133.242806:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953019776 00000100:00100000:3.0:1787388133.242887:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 231 00000100:00100000:3.0:1787388133.242897:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+65:12508:x1874211953019776:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388133.242928:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388133.242949:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd4ffa expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.243004:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.243016:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 66 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.243056:0:13489:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.243070:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 66 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.243084:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388133.243087:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388133.243091:0:13489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 66 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.243099:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497400, rc 0) 00000100:00100000:3.0:1787388133.243180:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+66:12508:x1874211953019776:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 284us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388133.243188:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 231 00000100:00100000:1.0:1787388133.387712:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388133.387739:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971942528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388133.387815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388133.387900:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971942528 00000100:00100000:1.0:1787388133.387907:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971942528 00000100:00100000:1.0:1787388133.387954:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787388133.387963:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971942528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388133.388025:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388133.388070:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971942528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388133.388078:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787388133.388122:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971942528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388133.518259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388133.959930:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388133.959940:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388133.959981:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787388133.959993:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388133.960148:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971942656:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388133.960266:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388133.972785:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971942656:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388133.982464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388133.985119:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953019904 00000100:00100000:0.0:1787388133.985141:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953019904 00000100:00100000:0.0:1787388133.985227:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 232 00000100:00100000:0.0:1787388133.985238:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d0d19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+66:12509:x1874211953019904:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388133.985312:0:9533:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388133.985459:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d0d19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+66:12509:x1874211953019904:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 222us (3004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388133.985468:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 232 00000100:00100000:0.0:1787388133.992653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388133.993079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953020032 00000100:00100000:3.0:1787388133.993089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953020032 00000100:00100000:3.0:1787388133.993148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 233 00000100:00100000:3.0:1787388133.993158:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+66:12509:x1874211953020032:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787388133.993233:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993249:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993261:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993318:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993327:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993335:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993360:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993370:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993377:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388133.993426:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787388133.993430:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388133.993444:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993455:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993462:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993469:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993484:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388133.993489:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993497:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993509:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:3.0:1787388133.993512:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388133.993517:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993524:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993537:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993542:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993548:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993552:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388133.993555:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993846:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993867:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9273da1a0900) 00010000:00010000:3.0:1787388133.993870:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388133.993873:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993878:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993893:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993898:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993903:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993907:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388133.993910:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993915:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993921:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388133.993924:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388133.993927:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388133.993932:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388133.994089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+66:12509:x1874211953020032:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 Request processed in 930us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388133.994099:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 233 00000100:00100000:2.0:1787388133.997380:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388133.997500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953020288 00000100:00100000:0.0:1787388133.997510:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953020288 00000100:00100000:0.0:1787388133.997715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 234 00000100:00100000:0.0:1787388133.997726:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+66:12509:x1874211953020288:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388133.997747:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388133.997766:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812a51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5001 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.997883:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.997899:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.997910:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388133.997922:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787388133.998001:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998008:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998033:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998039:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388133.998044:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998052:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998066:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388133.998069:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787388133.998075:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998081:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812a58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998126:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812a51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5001 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998137:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:0.0:1787388133.998140:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388133.998143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812a51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5001 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388133.998155:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:0.0:1787388133.998219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+67:12509:x1874211953020288:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 494us (944us total) trans 4294967507 rc 301/301 00000100:00100000:0.0:1787388133.998236:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 234 00000100:00100000:1.0:1787388134.001875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.001988:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953020416 00000100:00100000:2.0:1787388134.002000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953020416 00000100:00100000:2.0:1787388134.002062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 235 00000100:00100000:2.0:1787388134.002073:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+67:12509:x1874211953020416:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388134.002124:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388134.002238:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+67:12509:x1874211953020416:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 166us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388134.002247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 235 00000100:00100000:2.0:1787388134.006042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.006132:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953020672 00000100:00100000:0.0:1787388134.006142:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953020672 00000100:00100000:0.0:1787388134.006205:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 236 00000100:00100000:0.0:1787388134.006216:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+67:12509:x1874211953020672:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388134.006236:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388134.006240:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787388134.006265:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497a00/0x5cb77467b18129f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fe5 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.006291:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388134.006296:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388134.006311:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812a66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5008 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388134.006717:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787388134.006886:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812a6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.006900:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.006911:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.006963:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812a66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5008 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.007000:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5008 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.007008:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273e13c5b00) 00010000:00010000:0.0:1787388134.007011:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388134.007014:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff800, rc 0) 00000100:00100000:0.0:1787388134.007070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+68:12509:x1874211953020672:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 855us (1037us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787388134.007077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 236 00000100:00100000:0.0:1787388134.012004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.012137:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953020928 00000100:00100000:3.0:1787388134.012146:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953020928 00000100:00100000:3.0:1787388134.012238:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 237 00000100:00100000:3.0:1787388134.012248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+68:12509:x1874211953020928:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388134.012412:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388134.012438:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812a6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5008 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012458:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273e13c5b00) 00010000:00010000:3.0:1787388134.012468:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388134.012489:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012501:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012511:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012795:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012816:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012825:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012871:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012890:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012897:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012903:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388134.012907:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012915:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012925:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:3.0:1787388134.012927:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388134.012931:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012936:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1812a7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012946:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012953:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012959:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012964:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388134.012972:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012979:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012986:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd3826e97 (ffff9273da1a0900) 00010000:00010000:3.0:1787388134.012989:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388134.012992:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.012998:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1812a82 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd3826e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.013113:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+67:12509:x1874211953020928:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 865us (1116us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787388134.013122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 237 00000100:00100000:2.0:1787388134.015384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.015460:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953021056 00000100:00100000:3.0:1787388134.015468:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953021056 00000100:00100000:3.0:1787388134.015704:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 238 00000100:00100000:3.0:1787388134.015716:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+67:12509:x1874211953021056:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388134.015736:0:13489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388134.015758:0:13489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd500f expref: -99 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.015796:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.015820:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.015851:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.015965:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b1812a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 69 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.015985:0:13489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 68 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.015995:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:3.0:1787388134.015998:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388134.016002:0:13489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031200, rc 0) 00000100:00100000:3.0:1787388134.016057:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+68:12509:x1874211953021056:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 344us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.016065:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 238 00000100:00100000:0.0:1787388134.018842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.018943:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953021312 00000100:00100000:1.0:1787388134.018952:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953021312 00000100:00100000:1.0:1787388134.019049:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 239 00000100:00100000:1.0:1787388134.019061:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+68:12509:x1874211953021312:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787388134.019148:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.019165:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.019177:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388134.019496:0:9533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787388134.019507:0:9533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423003827121ns, next at 424003824351ns, rc = 0 00000004:00010000:1.0:1787388134.019559:0:9533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f2be216 reply state 00000000f93cd801 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.019643:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.019651:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:1.0:1787388134.019666:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787388134.019670:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388134.019931:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+70:12509:x1874211953021312:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 871us (1097us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787388134.019939:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 239 00000100:00100000:2.0:1787388134.022096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.022160:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953021440 00000100:00100000:3.0:1787388134.022170:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953021440 00000100:00100000:3.0:1787388134.022225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 240 00000100:00100000:3.0:1787388134.022235:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+70:12509:x1874211953021440:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388134.022257:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388134.022283:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5016 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.022344:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.022360:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.022394:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:3.0:1787388134.022397:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388134.022401:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030e00, rc 0) 00000100:00100000:3.0:1787388134.022458:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+71:12509:x1874211953021440:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 224us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.022465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 240 00000100:00100000:2.0:1787388134.025226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.025510:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953021568 00000100:00100000:0.0:1787388134.025521:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953021568 00000100:00080000:3.0:1787388134.025631:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388134.025717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 73 00000100:00100000:0.0:1787388134.025727:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+9:2404:x1874211953021568:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787388134.025961:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+10:2404:x1874211953021568:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 234us (744us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787388134.025969:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 73 00000100:00100000:2.0:1787388134.029389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.029479:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953021824 00000100:00100000:1.0:1787388134.029489:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953021824 00000100:00100000:1.0:1787388134.029547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:1.0:1787388134.029558:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+71:12509:x1874211953021824:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388134.029857:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+72:12509:x1874211953021824:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 300us (476us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1787388134.029865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:2.0:1787388134.031987:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.032060:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022080 00000100:00100000:3.0:1787388134.032068:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022080 00000100:00100000:3.0:1787388134.032115:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 241 00000100:00100000:3.0:1787388134.032124:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+72:12509:x1874211953022080:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388134.032218:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+72:12509:x1874211953022080:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.032225:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 241 00000100:00100000:3.0:1787388134.034784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.034953:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022208 00000100:00100000:1.0:1787388134.034963:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022208 00000100:00100000:1.0:1787388134.035022:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 242 00000100:00100000:1.0:1787388134.035032:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+72:12509:x1874211953022208:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388134.035051:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388134.035073:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812aa5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd501d expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.035169:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1812aac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.035184:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1812aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.035196:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1812aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388134.035254:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388134.035288:0:9533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1812aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.035422:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4800/0x5cb77467b1812aa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd501d expref: 74 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.035439:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1812aac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd501d expref: 73 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.035448:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:1.0:1787388134.035451:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388134.035454:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020400, rc 0) 00000100:00100000:1.0:1787388134.035514:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+73:12509:x1874211953022208:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 482us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.035521:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 242 00000100:00100000:0.0:1787388134.042078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.042398:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022336 00000100:00100000:3.0:1787388134.042409:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022336 00000100:00100000:3.0:1787388134.042470:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 74 00000100:00100000:3.0:1787388134.042481:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+10:2403:x1874211953022336:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388134.042498:0:10361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388134.042520:0:10361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5024 expref: -99 pid: 10361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388134.042545:0:10361:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960e6, blocks: 0x0 00010000:00010000:3.0:1787388134.042575:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1787388134.042596:0:10361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388134.042606:0:10361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 11 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.042627:0:10361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 11 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.042641:0:10361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030600, rc 0) 00000100:00100000:3.0:1787388134.042737:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+11:2403:x1874211953022336:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 257us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.042745:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 74 00000100:00100000:2.0:1787388134.045597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.045741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022592 00000100:00100000:0.0:1787388134.045751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022592 00000100:00100000:0.0:1787388134.045824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 243 00000100:00100000:0.0:1787388134.045836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+73:12509:x1874211953022592:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787388134.045949:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+73:12509:x1874211953022592:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.045970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 243 00000100:00100000:0.0:1787388134.048578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.048728:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022720 00000100:00100000:2.0:1787388134.048738:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022720 00000100:00100000:2.0:1787388134.048796:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 75 00000100:00100000:2.0:1787388134.048819:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+11:12509:x1874211953022720:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388134.048838:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388134.048859:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd502b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.048891:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 12 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.048900:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388134.048904:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388134.048910:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.048967:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 12 pid: 10361 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.048984:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 12 pid: 10361 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.048999:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211971942784:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388134.049100:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787388134.052633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.052823:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022848 00000100:00100000:3.0:1787388134.052832:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022848 00010000:00010000:3.0:1787388134.052871:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 13 pid: 10361 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.052906:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 103 00000100:00100000:3.0:1787388134.052916:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+13:2403:x1874211953022848:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388134.052931:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388134.052951:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 13 pid: 10361 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.052965:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 13 pid: 10361 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.052990:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388134.053005:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388134.053014:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.053025:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.053070:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.053085:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1874211971942912:192.168.204.52@tcp:105: 00000100:00100000:3.0:1787388134.053177:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787388134.053533:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075309c11/0x5cb77467b1812ab3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5024 expref: 13 pid: 10361 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.053550:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211971942784:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388134.053590:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.053602:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708a00, rc 0) 00000100:00100000:0.0:1787388134.053646:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+12:12509:x1874211953022720:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 4840us (5087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.053655:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 75 00000100:00100000:3.0:1787388134.059443:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1874211971942912:192.168.204.52@tcp:105: 00010000:00010000:3.0:1787388134.059473:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388134.059542:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+11:2403:x1874211953022848:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 6626us (6918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.059554:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 103 00000100:00100000:1.0:1787388134.061333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.061419:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953022976 00000100:00100000:3.0:1787388134.061429:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953022976 00002000:00100000:3.0:1787388134.061478:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9272c4469f80 x1874211953022976/t0(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:390/0 lens 504/0 e 0 to 0 dl 1787388145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388134.061489:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c4469f80 with x1874211953022976 ext(0->12) 00002000:00010000:3.0:1787388134.061495:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c4469f80 00000100:00100000:3.0:1787388134.061529:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:3.0:1787388134.061540:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+11:2403:x1874211953022976:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787388134.062630:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74df45bd-a066-4da5-9401-b0a043132784+13:2403:x1874211953022976:12345-192.168.204.52@tcp:4:lhsmtool_posix.0 Request processed in 1086us (1300us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787388134.062640:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00002000:00100000:3.0:1787388134.062649:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9272c4469f80 x1874211953022976/t4294967322(0) o4->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:390/0 lens 504/448 e 0 to 0 dl 1787388145 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388134.062658:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c4469f80 with x1874211953022976 ext(0->12) 00002000:00010000:3.0:1787388134.062663:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c4469f80 00000100:00100000:1.0:1787388134.065719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.065926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953023104 00000100:00100000:2.0:1787388134.065937:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953023104 00000100:00100000:2.0:1787388134.066006:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 244 00000100:00100000:2.0:1787388134.066016:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+73:12509:x1874211953023104:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388134.068059:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000004:00080000:3.0:1787388134.068078:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787388134.068116:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787388134.068122:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787388134.068142:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9273ff9c1480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787388134.068147:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c34a2e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9273ff9c1840 00000020:00080000:3.0:1787388134.068150:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c34a2d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c3d37800 00000020:00080000:3.0:1787388134.068198:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9273c30bb9c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787388134.068202:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c34a2400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9273c7d599c0 00000020:00080000:3.0:1787388134.068205:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9272c34a2a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c3d40000 00000020:00080000:3.0:1787388134.068216:0:6499:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787388134.068231:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1787388134.068492:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388134.068510:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971943168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787388134.068592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388134.068632:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388134.068641:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971943040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787388134.068668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388134.068733:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971943168 00000100:00100000:2.0:1787388134.068740:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971943168 00000100:00100000:2.0:1787388134.068791:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971943040 00000100:00100000:2.0:1787388134.068794:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971943040 00000100:00100000:2.0:1787388134.068826:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787388134.068835:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1874211971943168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787388134.068959:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787388134.068963:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787388134 00002000:00010000:2.0:1787388134.068965:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787388134.068967:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787388134 -> 1787388134 00002000:00010000:2.0:1787388134.068969:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787388134.069011:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1874211971943168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (418us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787388134.069020:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787388134.069040:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787388134.069047:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1874211971943040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787388134.069061:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787388134.069077:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.069098:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.069107:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787388134.069111:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388134.069116:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.069143:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.069158:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 12 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.069176:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971943296:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388134.069235:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1f00 going to sleep for 11 seconds 00000100:00080000:2.0:1787388134.069252:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787388134.069282:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c44eb800/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787388134.069288:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971943168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787388134.069379:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+27:12509:x1874211953023104:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 Request processed in 3364us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388134.069388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 244 00000020:00080000:3.0:1787388134.070027:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787388134.070525:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388134.070544:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971943424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787388134.070801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388134.071615:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071630:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071637:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071644:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.071648:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071656:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071706:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9273c39fc400) 00010000:00010000:0.0:1787388134.071710:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.071715:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071722:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4600/0x5cb77467b18127bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071757:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071764:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071769:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071774:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.071777:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071782:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071789:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9273c39fcd00) 00010000:00010000:0.0:1787388134.071792:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.071795:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071801:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b1812867 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071841:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071848:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071854:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071861:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.071864:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071869:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071879:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:0.0:1787388134.071881:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.071884:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071889:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18128e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071902:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071908:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071915:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071926:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.071930:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071936:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071944:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273da1a0a00) 00010000:00010000:0.0:1787388134.071947:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.071949:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071955:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273dfafa600/0x5cb77467b1812908 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071974:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071980:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071986:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071991:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.071994:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.071999:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072019:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388134.072021:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.072023:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072028:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708400/0x5cb77467b18129da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072041:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072046:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072051:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072055:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5a00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.072057:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072063:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072069:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:0.0:1787388134.072071:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787388134.072073:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.072079:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5a00/0x5cb77467b1812a97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.074092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.074173:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211971943296:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388134.074204:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.076740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.076823:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971943424 00000100:00100000:1.0:1787388134.076834:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971943424 00000100:00100000:1.0:1787388134.076906:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953023232 00000100:00100000:1.0:1787388134.076910:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953023232 00000100:00100000:1.0:1787388134.076930:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787388134.076939:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1874211971943424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787388134.076969:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1787388134.077001:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8960e4, atime: 0x6a8960e4, ctime: 0x6a8960e4, blocks: 0x8 00010000:00010000:1.0:1787388134.077010:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.077037:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1787388134.077042:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388134.077048:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.077064:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.077074:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.077082:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.077098:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388134.077259:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3644:x1874211971943424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 321us (6458us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787388134.077267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787388134.077295:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:1.0:1787388134.077309:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+13:2404:x1874211953023232:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787388134.078371:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388134.078381:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.078393:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388134.078398:0:10340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.078407:0:10340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.078427:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.078435:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812ac8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.078455:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388134.078457:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388134.078458:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787388134.078467:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388134.078939:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953023360 00000100:00100000:2.0:1787388134.078948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953023360 00010000:00010000:2.0:1787388134.078982:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 14 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.079016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 104 00000100:00100000:2.0:1787388134.079024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+14:2404:x1874211953023360:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388134.079036:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388134.079042:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 14 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.079055:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 14 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.079081:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74b562d/0x5cb77467b1812875 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f83 expref: 14 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.079095:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388134.079099:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388134.079104:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.079113:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.079141:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388134.079196:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+13:2404:x1874211953023360:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 172us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388134.079203:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 104 00000004:00080000:2.0:1787388134.079256:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c446aa00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787388134.079264:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971943424:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787388134.080226:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.080241:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.080277:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.080287:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.080389:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388134.080705:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388134.080713:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.080722:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388134.080734:0:7471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.080743:0:7471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.080766:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.080774:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089363963/0x5cb77467b1812ac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.080798:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388134.080800:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388134.080802:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787388134.080858:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787388134.080869:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1787388134.086063:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953023232:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 Request processed in 8742us (11961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.086080:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 79 00000100:00100000:1.0:1787388134.089760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.089885:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953023616 00000100:00100000:3.0:1787388134.089895:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953023616 00000100:00100000:3.0:1787388134.089953:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 245 00000100:00100000:3.0:1787388134.089963:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+21:12509:x1874211953023616:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388134.090017:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388134.090043:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1812aac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd501d expref: 21 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.090063:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:3.0:1787388134.090067:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388134.090100:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.090115:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.090126:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388134.090259:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f1b1078 reply state 00000000fdb54738 transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.090286:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.090294:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:3.0:1787388134.090297:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388134.090323:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388134.090670:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+22:12509:x1874211953023616:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 707us (920us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1787388134.090707:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 245 00000100:00100000:3.0:1787388134.093169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.093428:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971943040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24377us (24754us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787388134.093442:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787388134.093930:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953023744 00000100:00100000:0.0:1787388134.093941:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953023744 00000100:00100000:1.0:1787388134.095710:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 80 00000100:00100000:1.0:1787388134.095739:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211953023744:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787388134.095946:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787388134.095950:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787388134 -> 1787388133 00002000:00010000:1.0:1787388134.095953:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787388132 00002000:00010000:1.0:1787388134.095955:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787388134 -> 1787388133 00002000:00010000:1.0:1787388134.095971:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787388134.096039:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953023744:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 313us (2877us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787388134.096047:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 80 00000004:00080000:2.0:1787388134.098573:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c44eb100/2, rc 0, transno 4294967324 00000100:00100000:2.0:1787388134.098590:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971943040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787388134.099258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.099443:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024000 00000100:00100000:3.0:1787388134.099452:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024000 00000100:00100000:3.0:1787388134.100078:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 246 00000100:00100000:3.0:1787388134.100091:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+22:12509:x1874211953024000:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787388134.100162:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.100180:0:13489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 22 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.100190:0:13489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.100223:0:13489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 22 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.100237:0:13489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 22 pid: 13489 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.100252:0:13489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971943552:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388134.100475:0:13489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388134.104055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.104134:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024128 00000100:00100000:2.0:1787388134.104144:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024128 00010000:00010000:2.0:1787388134.104182:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 23 pid: 13489 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.104225:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 105 00000100:00100000:2.0:1787388134.104243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+23:2404:x1874211953024128:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388134.104258:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388134.104265:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 23 pid: 13489 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.104291:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 23 pid: 13489 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.104474:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:2.0:1787388134.104481:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.104492:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.104500:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.104520:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388134.104592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74df45bd-a066-4da5-9401-b0a043132784+23:2404:x1874211953024128:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 351us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388134.104600:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 105 00010000:00010000:3.0:1787388134.105612:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812a90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd500f expref: 22 pid: 13489 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.105650:0:13489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13489:1874211971943552:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388134.105672:0:13489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105762:0:13489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105769:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105823:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105829:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105835:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105841:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388134.105845:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105852:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105864:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:3.0:1787388134.105867:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787388134.105870:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.105883:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b1812ad6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.105958:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+21:12509:x1874211953024000:12345-192.168.204.52@tcp:55:lhsmtool_posix.0 Request processed in 5870us (6703us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787388134.105968:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 246 00000100:00100000:1.0:1787388134.108768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.108873:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024256 00000100:00100000:2.0:1787388134.108883:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024256 00000100:00100000:2.0:1787388134.108938:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 81 00000100:00100000:2.0:1787388134.108949:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953024256:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787388134.108994:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.109034:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.109043:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388134.109047:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388134.109052:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.109091:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.109105:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 8 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.109121:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874211971943680:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388134.109204:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388134.112595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.112815:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874211971943680:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388134.112847:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.112929:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024384 00000100:00100000:3.0:1787388134.112936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024384 00010000:00010000:3.0:1787388134.112970:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 9 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.113009:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 106 00000100:00100000:3.0:1787388134.113019:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+9:2403:x1874211953024384:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388134.113034:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388134.113056:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 9 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.113070:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 9 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.113094:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b1812aba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd502b expref: 9 pid: 8436 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.113111:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388134.113115:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388134.113121:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.113146:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.113178:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388134.113227:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+8:2403:x1874211953024384:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 208us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.113234:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 106 00010000:00010000:2.0:1787388134.114704:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114723:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114750:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114776:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114785:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114792:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388134.114796:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114818:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114837:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.114844:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002616af6b/0x5cb77467b1812add lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.114929:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2403:x1874211953024256:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 Request processed in 5979us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388134.114938:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 81 00000100:00100000:2.0:1787388134.117258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.117543:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024640 00000100:00100000:0.0:1787388134.117553:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024640 00000100:00100000:0.0:1787388134.117622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 247 00000100:00100000:0.0:1787388134.117631:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+21:12509:x1874211953024640:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787388134.117753:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.117771:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.117780:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.117827:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.117862:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 21 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.117878:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971943808:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388134.117954:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388134.120094:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971943808:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388134.120132:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.121908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.122186:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024768 00000100:00100000:1.0:1787388134.122197:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024768 00010000:00010000:1.0:1787388134.122232:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 22 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388134.122277:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 107 00000100:00100000:1.0:1787388134.122285:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+22:2403:x1874211953024768:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388134.122300:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388134.122315:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 22 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122328:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 22 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122349:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b18129d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4fd7 expref: 22 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122384:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388134.122390:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 21 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122399:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122407:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122414:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.122437:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388134.122493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+21:2403:x1874211953024768:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 207us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.122501:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 107 00010000:00010000:0.0:1787388134.123098:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.123108:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.123300:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.123408:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.123416:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.123448:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.123461:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 21 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.123474:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971943936:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388134.123596:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388134.128009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.128075:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953024896 00000100:00100000:1.0:1787388134.128085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953024896 00010000:00010000:1.0:1787388134.128124:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 22 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388134.128159:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 108 00000100:00100000:1.0:1787388134.128169:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+22:2404:x1874211953024896:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388134.128183:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388134.128189:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 22 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.128218:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 22 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.128244:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:1.0:1787388134.128250:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.128260:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.128267:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.128295:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388134.128419:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030e00/0x5cb77467b1812a9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5016 expref: 22 pid: 6520 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.128437:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971943936:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388134.128454:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.128463:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.128469:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388134.128601:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1787388134.128737:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000001:00080000:0.0:1787388134.128774:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1787388134.128869:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971944064:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787388134.128917:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.128944:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388134.128965:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971944064 00000100:00100000:0.0:1787388134.128969:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971944064 00000100:00100000:0.0:1787388134.129003:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787388134.129011:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971944064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787388134.129082:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971944064:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.129089:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787388134.129119:0:6521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1787388134.129125:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967323 00000004:00080000:0.0:1787388134.129150:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c44eb800, transno 4294967323 00000100:00100000:0.0:1787388134.129172:0:6521:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9272c44eb100 x1874211971943040/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787388150 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388134.129183:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971944064:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787388134.129281:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:0.0:1787388134.129319:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971944192:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787388134.129344:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.129360:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388134.130520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74df45bd-a066-4da5-9401-b0a043132784+25:2404:x1874211953024896:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 2344us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.130542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 108 00000100:00100000:1.0:1787388134.130720:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971944192 00000100:00100000:1.0:1787388134.130728:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971944192 00000100:00100000:1.0:1787388134.130767:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787388134.130775:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1874211971944192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787388134.130937:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1874211971944192:12345-0@lo:1000:mdt00_001.0 Request processed in 162us (1591us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787388134.130944:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787388134.131012:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874211971944192:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787388134.131054:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131079:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131085:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131091:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388134.131095:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131117:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:1.0:1787388134.131120:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388134.131124:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131129:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812aeb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131153:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131158:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131168:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388134.131176:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131182:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131190:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388134.131192:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388134.131197:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131208:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131216:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.131245:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 24 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388134.131257:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971944320:192.168.204.52@tcp:105: 00000100:00100000:1.0:1787388134.137130:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388134.140209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.140316:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953025024 00000100:00100000:3.0:1787388134.140326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953025024 00000100:00100000:3.0:1787388134.140388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:3.0:1787388134.140398:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+25:12508:x1874211953025024:12345-192.168.204.52@tcp:49:lfs.0 00000100:00100000:3.0:1787388134.140523:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+25:12508:x1874211953025024:12345-192.168.204.52@tcp:49:lfs.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.140531:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:0.0:1787388134.143126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.143214:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953025280 00000100:00100000:3.0:1787388134.143225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953025280 00000100:00100000:3.0:1787388134.143294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 248 00000100:00100000:3.0:1787388134.143313:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+25:12508:x1874211953025280:12345-192.168.204.52@tcp:58:lfs.0 00000040:00080000:3.0:1787388134.143485:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787388134.145941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+25:12508:x1874211953025280:12345-192.168.204.52@tcp:58:lfs.0 Request processed in 2625us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.145956:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 248 00000100:00100000:1.0:1787388134.146113:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971944320:192.168.204.52@tcp:105: 00010000:00010000:1.0:1787388134.146140:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146151:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4e00/0x5cb77467b1812a2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146206:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146221:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146233:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146244:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146250:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146257:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146264:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388134.146371:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146381:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146393:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388134.146397:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388134.146401:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021200/0x5cb77467b1812af2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146424:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146430:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146436:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146442:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffc00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388134.146445:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146450:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146458:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388134.146461:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388134.146464:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.146470:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812ae4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388134.146770:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388134.146775:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388134.146815:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787388134.146822:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388134.146937:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971944448:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388134.147016:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c63c8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388134.149770:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+25:12509:x1874211953024640:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 32128us (32509us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787388134.149785:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 247 00000020:00080000:1.0:1787388134.149792:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787388134.157614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388134.157653:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953025408 00000100:00100000:1.0:1787388134.157714:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953025408 00000100:00100000:1.0:1787388134.157783:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 249 00000100:00100000:1.0:1787388134.157794:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+25:12510:x1874211953025408:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787388134.157843:0:13489:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787388134.157960:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+25:12510:x1874211953025408:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 168us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.157968:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 249 00000100:00100000:3.0:1787388134.159096:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1874211971944448:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388134.177830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.177916:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953025664 00000100:00100000:3.0:1787388134.177926:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953025664 00000100:00100000:3.0:1787388134.177982:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:3.0:1787388134.177993:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+24:12509:x1874211953025664:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787388134.178249:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787388134.178298:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967517 00010000:00010000:3.0:1787388134.178437:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.178454:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.178465:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.178473:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.178480:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.178486:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.178568:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787388134.178675:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+26:12509:x1874211953025664:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 682us (851us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787388134.178735:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 62 00000020:00080000:3.0:1787388134.178740:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388134.182004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.182105:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953025920 00000100:00100000:0.0:1787388134.182115:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953025920 00000100:00100000:0.0:1787388134.182182:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 250 00000100:00100000:0.0:1787388134.182192:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+26:12510:x1874211953025920:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388134.182212:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388134.182231:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812b00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5032 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.182368:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.182383:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.182394:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388134.182405:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787388134.182518:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812b00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5032 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.182724:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5032 expref: 28 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.182737:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388134.182740:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787388134.182744:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:0.0:1787388134.182821:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+28:12510:x1874211953025920:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 630us (824us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787388134.182829:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 250 00010000:00010000:1.0:1787388134.185099:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388134.185116:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.185128:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388134.185132:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.185143:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.185161:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:1.0:1787388134.185164:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787388134.185168:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388134.185173:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031200/0x5cb77467b1812af9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.185402:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388134.185404:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388134.185406:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388134.192132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.192258:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953026048 00000100:00100000:0.0:1787388134.192278:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953026048 00000100:00100000:0.0:1787388134.192375:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 251 00000100:00100000:0.0:1787388134.192385:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+28:12512:x1874211953026048:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388134.192409:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388134.192429:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812b15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5039 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192490:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192504:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192515:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192549:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192579:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192585:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192666:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192699:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192708:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192744:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.192757:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 29 pid: 9533 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.192770:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971944576:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388134.192873:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bd0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388134.198049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.198152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953026304 00000100:00100000:2.0:1787388134.198164:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953026304 00000100:00100000:2.0:1787388134.198223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 252 00000100:00100000:2.0:1787388134.198232:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+30:12510:x1874211953026304:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787388134.198334:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198353:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198367:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198524:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198533:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198540:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198576:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388134.198581:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198589:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198601:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388134.198605:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388134.198609:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388134.198615:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b1812b31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388134.198785:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+31:12510:x1874211953026304:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 553us (745us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787388134.198793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 252 00000040:00080000:3.0:1787388134.199028:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388134.199033:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388134.199476:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787388134.199484:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388134.203030:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211971944576:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388134.203062:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388134.205086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388134.205180:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953026560 00000100:00100000:2.0:1787388134.205190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953026560 00000100:00100000:2.0:1787388134.205246:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:2.0:1787388134.205257:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+31:6172:x1874211953026560:12345-192.168.204.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787388134.205500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+32:6172:x1874211953026560:12345-192.168.204.52@tcp:35:ldlm_bl.0 Request processed in 245us (424us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787388134.205509:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:2.0:1787388134.207187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388134.207285:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953026816 00000100:00100000:0.0:1787388134.207294:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953026816 00000100:00100000:0.0:1787388134.207349:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:0.0:1787388134.207359:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+32:12510:x1874211953026816:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388134.207891:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+33:12510:x1874211953026816:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 530us (708us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787388134.207900:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:1.0:1787388134.211607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388134.211716:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953026944 00000100:00100000:3.0:1787388134.211728:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953026944 00010000:00010000:3.0:1787388134.211768:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 33 pid: 9533 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388134.211814:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 109 00000100:00100000:3.0:1787388134.211823:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+33:2401:x1874211953026944:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388134.211837:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388134.211843:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 33 pid: 9533 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.211857:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 33 pid: 9533 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.211879:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4c00/0x5cb77467b1812a20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ff3 expref: 33 pid: 9533 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.211895:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:3.0:1787388134.211900:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.211927:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.211935:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388134.211956:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388134.212002:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74df45bd-a066-4da5-9401-b0a043132784+32:2401:x1874211953026944:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 180us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.212009:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 109 00010000:00010000:0.0:1787388134.212185:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212194:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388134.212244:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787388134.212248:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388134.212277:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212290:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212300:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212307:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212314:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212326:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.212331:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212339:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212349:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:0.0:1787388134.212352:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.212355:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212361:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff400/0x5cb77467b1812b1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212373:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212379:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212385:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212390:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388134.212393:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212398:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212413:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9273e13c5300) 00010000:00010000:0.0:1787388134.212416:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388134.212419:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212425:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff800/0x5cb77467b1812b23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212457:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ff600/0x5cb77467b1812b15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5039 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212469:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5039 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388134.212477:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:0.0:1787388134.212479:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388134.212482:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffc00, rc 0) 00000100:00100000:0.0:1787388134.212509:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+31:12512:x1874211953026048:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 20125us (20388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.212515:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 251 00010000:00010000:0.0:1787388134.536287:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388134.921523:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971944704:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.921604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.921658:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971945216:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.922508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.922542:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971945728:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.922576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.922603:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971946240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388134.922626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.922643:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787388134.922650:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971944832:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.922670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.922973:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971945344:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923024:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971945856:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971946368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388134.923101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923148:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971944960:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923192:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971945472:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923212:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923230:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971945984:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923274:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787388134.923281:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971945088:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923481:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971945600:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.923509:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923525:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971946112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388134.923550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.923594:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971944704 00000100:00100000:3.0:1787388134.923602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971944704 00000100:00100000:3.0:1787388134.923665:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787388134.923674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971944704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.924198:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945728 00000100:00100000:1.0:1787388134.924204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945728 00000100:00100000:1.0:1787388134.924256:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971944832 00000100:00100000:1.0:1787388134.924259:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971944832 00000100:00100000:1.0:1787388134.924272:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945856 00000100:00100000:1.0:1787388134.924275:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945856 00000100:00100000:1.0:1787388134.924287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945472 00000100:00100000:1.0:1787388134.924290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945472 00000100:00100000:1.0:1787388134.924300:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945088 00000100:00100000:1.0:1787388134.924302:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945088 00000100:00100000:1.0:1787388134.924312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945600 00000100:00100000:1.0:1787388134.924314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945600 00000100:00100000:1.0:1787388134.924330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787388134.924336:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971945728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.924447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971944704:12345-0@lo:400:kworker.0 Request processed in 771us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.924457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787388134.924503:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945216 00000100:00100000:3.0:1787388134.924507:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945216 00000100:00100000:3.0:1787388134.924530:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946240 00000100:00100000:3.0:1787388134.924534:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946240 00000100:00100000:3.0:1787388134.924561:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971944960 00000100:00100000:3.0:1787388134.924564:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971944960 00000100:00100000:3.0:1787388134.924577:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787388134.924583:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971945216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.924933:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946368 00000100:00100000:0.0:1787388134.924938:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946368 00000100:00100000:0.0:1787388134.924972:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946112 00000100:00100000:0.0:1787388134.924976:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946112 00000100:00100000:0.0:1787388134.924989:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787388134.924995:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971946368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388134.925016:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388134.934024:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971946368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9016us (10910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.934040:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787388134.934087:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787388134.934102:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3644:x1874211971946112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388134.934127:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388134.934213:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3644:x1874211971946112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (10662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.934221:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1787388134.934765:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388134.934771:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388134.934774:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388134.937232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971945728:12345-0@lo:400:kworker.0 Request processed in 12882us (14640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.937250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787388134.937295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787388134.937307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.937372:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971944832:12345-0@lo:400:kworker.0 Request processed in 70us (14700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.937378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787388134.937389:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787388134.937396:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971945856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.937421:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874211971945856:12345-0@lo:400:kworker.0 Request processed in 28us (14377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.937427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787388134.937436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787388134.937443:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971945472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.937465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971945472:12345-0@lo:400:kworker.0 Request processed in 22us (14252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.937478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787388134.937489:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787388134.937496:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971945088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.937522:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971945088:12345-0@lo:400:kworker.0 Request processed in 27us (14072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.937527:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787388134.937541:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787388134.937548:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971945600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.937572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971945600:12345-0@lo:400:kworker.0 Request processed in 26us (14064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.937577:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787388134.940917:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945344 00000100:00100000:1.0:1787388134.940931:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945344 00000100:00080000:0.0:1787388134.940973:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388134.941006:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971945984 00000100:00100000:1.0:1787388134.941011:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971945984 00000100:00100000:1.0:1787388134.941047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787388134.941059:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971945344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.941227:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971945344:12345-0@lo:400:kworker.0 Request processed in 170us (18220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.941236:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787388134.941256:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787388134.941263:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971945984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.941298:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971945984:12345-0@lo:400:kworker.0 Request processed in 36us (18044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.941304:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787388134.941342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787388134.941350:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971946240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388134.941381:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787388134.941427:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971945216:12345-0@lo:400:kworker.0 Request processed in 16840us (18918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.941429:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971946240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (18800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.941442:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787388134.941559:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971945088:0@lo:400:kworker.0 00010000:00080000:2.0:1787388134.941796:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e46d80 x1874211971945600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388134.941808:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971945600:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.941903:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971946112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388134.941918:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971945472:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.941929:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971945984:0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.942026:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787388134.942044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787388134.942052:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971944960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.942223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c44ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971944960:12345-0@lo:400:kworker.0 Request processed in 172us (19048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.942230:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787388134.942276:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971944960:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.943219:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971944832:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.943234:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971945344:0@lo:400:kworker.0 00010000:00080000:2.0:1787388134.943248:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e47480 x1874211971945856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388134.943258:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971945856:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.943276:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971946368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388134.943290:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971946240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388134.943301:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971944704:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.943312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971945216:0@lo:400:kworker.0 00000100:00100000:2.0:1787388134.943322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971945728:0@lo:400:kworker.0 00000001:00080000:1.0:1787388134.944137:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1787388134.944153:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:3.0:1787388135.078433:0:14763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388135.078444:0:14763:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388135.078551:0:14763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787388135.078557:0:14763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388135.258018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388135.258066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388135.258149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388135.258172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388135.262027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027072 00000100:00100000:0.0:1787388135.262043:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027072 00000100:00100000:0.0:1787388135.262493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 390 00000100:00100000:0.0:1787388135.262503:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211953027072:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388135.262705:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2404:x1874211953027072:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 202us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388135.262713:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 390 00000100:00100000:1.0:1787388135.262833:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027328 00000100:00100000:1.0:1787388135.262838:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027328 00000100:00100000:1.0:1787388135.262893:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027840 00000100:00100000:1.0:1787388135.262897:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027840 00000100:00100000:1.0:1787388135.262920:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 328 00000100:00100000:1.0:1787388135.262927:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211953027328:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388135.262963:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211953027328:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 37us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388135.262969:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 328 00000100:00100000:2.0:1787388135.262973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388135.262986:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027200 00000100:00100000:1.0:1787388135.262989:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027200 00000100:00100000:1.0:1787388135.263006:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 329 00000100:00100000:2.0:1787388135.263008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388135.263012:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211953027840:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388135.263031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388135.263045:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027712 00000100:00100000:2.0:1787388135.263049:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027712 00000100:00100000:1.0:1787388135.263051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211953027840:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 39us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388135.263058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 329 00000100:00100000:2.0:1787388135.263070:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 330 00000100:00100000:1.0:1787388135.263073:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 331 00000100:00100000:2.0:1787388135.263076:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+31:2404:x1874211953027200:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388135.263079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211953027712:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388135.263100:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2404:x1874211953027712:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 21us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388135.263101:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74df45bd-a066-4da5-9401-b0a043132784+31:2404:x1874211953027200:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 26us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388135.263106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 331 00000100:00100000:1.0:1787388135.263129:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027584 00000100:00100000:1.0:1787388135.263133:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027584 00000100:00080000:0.0:1787388135.263136:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388135.263141:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388135.263143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388135.263158:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953027456 00000100:00100000:1.0:1787388135.263161:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953027456 00000100:00100000:0.0:1787388135.263166:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:0.0:1787388135.263173:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211953027584:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388135.263181:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:1.0:1787388135.263186:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953027456:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388135.263198:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2404:x1874211953027584:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 27us (5050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388135.263205:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953027456:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 20us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388135.263212:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:0.0:1787388135.263215:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:2.0:1787388135.267501:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 330 00000100:00100000:2.0:1787388135.290544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388135.292117:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028096 00000100:00100000:1.0:1787388135.292130:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028096 00000100:00100000:1.0:1787388135.292374:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 253 00000100:00100000:1.0:1787388135.292387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+31:12535:x1874211953028096:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388135.292408:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388135.292430:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021c00/0x5cb77467b1812b38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5040 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.292559:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1812b3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.292576:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1812b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.292591:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1812b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388135.292604:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787388135.292747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021c00/0x5cb77467b1812b38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5040 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.292765:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1812b3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5040 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.292772:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388135.292775:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388135.292789:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020200, rc 0) 00000100:00100000:1.0:1787388135.292855:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+33:12535:x1874211953028096:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 471us (2323us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787388135.293880:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 253 00000100:00100000:1.0:1787388135.295715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388135.295805:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028224 00000100:00100000:2.0:1787388135.295815:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028224 00000100:00100000:2.0:1787388135.295871:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 254 00000100:00100000:2.0:1787388135.295882:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+33:12535:x1874211953028224:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:2.0:1787388135.295951:0:13489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.295967:0:13489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.295979:0:13489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296014:0:13489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296020:0:13489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296046:0:13489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296052:0:13489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388135.296057:0:13489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296064:0:13489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296076:0:13489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:2.0:1787388135.296079:0:13489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388135.296084:0:13489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388135.296090:0:13489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1812b4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388135.296157:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+33:12535:x1874211953028224:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 277us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388135.296165:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 254 00000100:00100000:3.0:1787388135.382014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388135.384898:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028352 00000100:00100000:1.0:1787388135.384914:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028352 00000100:00100000:1.0:1787388135.385669:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 82 00000100:00100000:1.0:1787388135.386006:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+7:2402:x1874211953028352:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:1.0:1787388135.386043:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388135.386084:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b51ee777/0x5cb77467b1812b54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5047 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388135.386113:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8960e5, atime: 0x6a8960e4, ctime: 0x6a8960e5, blocks: 0x8 00010000:00010000:1.0:1787388135.386134:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1787388135.386138:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388135.386149:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51ee777/0x5cb77467b1812b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5047 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.386167:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b51ee777/0x5cb77467b1812b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5047 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388135.386180:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021c00, rc 0) 00000100:00100000:1.0:1787388135.386257:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2402:x1874211953028352:12345-192.168.204.52@tcp:101:cat.0 Request processed in 578us (4254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388135.386265:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 82 00000100:00100000:3.0:1787388135.393431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388135.394434:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028480 00000100:00100000:0.0:1787388135.394446:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028480 00002000:00100000:0.0:1787388135.394501:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9272c364ea00 x1874211953028480/t0(0) o3->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:391/0 lens 488/0 e 0 to 0 dl 1787388146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388135.394513:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c364ea00 with x1874211953028480 ext(0->4095) 00002000:00010000:0.0:1787388135.394518:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c364ea00 00000100:00100000:0.0:1787388135.394556:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:0.0:1787388135.394565:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211953028480:12345-192.168.204.52@tcp:3:cat.0 00000100:00100000:0.0:1787388135.394838:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:74df45bd-a066-4da5-9401-b0a043132784+8:2401:x1874211953028480:12345-192.168.204.52@tcp:3:cat.0 Request processed in 272us (1416us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787388135.395374:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 8 00002000:00100000:0.0:1787388135.395384:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9272c364ea00 x1874211953028480/t0(0) o3->74df45bd-a066-4da5-9401-b0a043132784@192.168.204.52@tcp:391/0 lens 488/4536 e 0 to 0 dl 1787388146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388135.395393:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9272c364ea00 with x1874211953028480 ext(0->4095) 00002000:00010000:0.0:1787388135.395397:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9272c364ea00 00010000:00010000:0.0:1787388135.560009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388136.584815:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388137.612381:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388137.992120:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388137.992148:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971946496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388137.992220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388137.992290:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946496 00000100:00100000:3.0:1787388137.992311:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946496 00000100:00100000:3.0:1787388137.992366:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787388137.992377:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874211971946496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388137.992413:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787388137.992458:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874211971946496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388137.992465:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1787388137.992489:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388137.992531:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971946496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388137.992884:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388137.992921:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971946624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388137.992956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388137.993042:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946624 00000100:00100000:2.0:1787388137.993047:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946624 00000100:00100000:2.0:1787388137.993088:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787388137.993095:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971946624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388137.993109:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388137.993146:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971946624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388137.993165:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787388137.993212:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388137.993237:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971946624:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787388138.185422:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787388138.314169:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388138.314180:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388138.314200:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787388138.314208:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388138.506800:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971946752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388138.506901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388138.511736:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946752 00000100:00100000:1.0:1787388138.511753:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946752 00000100:00100000:1.0:1787388138.511807:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787388138.511824:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971946752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388138.511861:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388138.512079:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971946752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388138.512087:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787388138.512986:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971946752:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388138.631963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388139.658605:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388140.040442:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971946880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388140.040505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.040636:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971946880 00000100:00100000:2.0:1787388140.040643:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971946880 00000100:00100000:2.0:1787388140.040711:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787388140.040720:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971946880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388140.040746:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388140.040786:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971946880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.040793:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787388140.040836:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787388140.040842:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1787388140.040876:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9273ffa85f80, transno 4294967308 00000004:00080000:2.0:1787388140.040884:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787388140.040896:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c446aa00, transno 4294967311 00000100:00100000:2.0:1787388140.040905:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971946880:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787388140.041044:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388140.041159:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971947008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388140.041189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388140.041420:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947008 00000100:00100000:1.0:1787388140.041425:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947008 00000100:00100000:1.0:1787388140.041452:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787388140.041458:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971947008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388140.041478:0:7930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787388140.041511:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971947008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.041517:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787388140.041546:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971947008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388140.042203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971947136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388140.042243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.042809:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947136 00000100:00100000:2.0:1787388140.042816:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947136 00000100:00100000:2.0:1787388140.042861:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787388140.042868:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971947136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388140.042888:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388140.042932:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971947136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.042939:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787388140.043459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388140.043497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971947136:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1787388140.043620:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1787388140.043665:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9273c6bd0d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787388140.043669:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273fbe32000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9273c6bd0600 00000020:00080000:0.0:1787388140.043715:0:6499:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9273fbe32200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9272c45fc200 00000020:00080000:0.0:1787388140.043732:0:6499:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787388140.043745:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000001:00080000:2.0:1787388140.043817:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:2.0:1787388140.043826:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000020:00080000:0.0:1787388140.043937:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787388140.044384:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.044396:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.044418:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.044425:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388140.044429:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.044437:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.044459:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9273da1a0e00) 00010000:00010000:1.0:1787388140.044462:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388140.044467:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.044473:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031400/0x5cb77467b1812acf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388140.046500:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971947392:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.046581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.046620:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971947904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.046646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.046662:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971948416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.046722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.046754:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787388140.046761:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971947264:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.046792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.046814:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971947776:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.046836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.046853:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971948288:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.046874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.046907:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947392 00000100:00100000:2.0:1787388140.046916:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947392 00000100:00100000:2.0:1787388140.046961:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948416 00000100:00100000:2.0:1787388140.046965:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948416 00000100:00100000:2.0:1787388140.046985:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948288 00000100:00100000:2.0:1787388140.046988:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948288 00000100:00100000:2.0:1787388140.047003:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787388140.047010:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971947392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.047062:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971947392:12345-0@lo:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.047070:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787388140.047090:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787388140.047105:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971948416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.047136:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971948416:12345-0@lo:400:kworker.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.047142:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787388140.047170:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787388140.047178:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971948288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388140.049341:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947904 00000100:00100000:0.0:1787388140.049359:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947904 00000100:00100000:0.0:1787388140.049428:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947776 00000100:00100000:0.0:1787388140.049432:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947776 00000100:00100000:0.0:1787388140.049471:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787388140.049484:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971947904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.049488:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787388140.049501:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971947776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.055037:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971947776:12345-0@lo:400:kworker.0 Request processed in 5529us (8189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.055055:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1787388140.055124:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388140.055131:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388140.055136:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388140.055160:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971947520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.055517:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388140.055740:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971948032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.055767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388140.055790:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787388140.055798:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971947648:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.055903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388140.055925:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971948160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.055947:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388140.055981:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947648 00000100:00100000:1.0:1787388140.055988:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947648 00000100:00100000:1.0:1787388140.056036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787388140.056044:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971947648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.056102:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971947648:12345-0@lo:400:kworker.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.056110:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787388140.056131:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947520 00000100:00100000:1.0:1787388140.056134:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947520 00000100:00100000:1.0:1787388140.056152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948032 00000100:00100000:1.0:1787388140.056155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948032 00000100:00100000:1.0:1787388140.056178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948160 00000100:00100000:1.0:1787388140.056181:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948160 00000100:00100000:1.0:1787388140.056735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787388140.056749:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971947520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.056794:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971947520:12345-0@lo:400:kworker.0 Request processed in 50us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.056803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787388140.056878:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787388140.056887:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971948032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.056932:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971948032:12345-0@lo:400:kworker.0 Request processed in 46us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.056939:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787388140.056951:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787388140.056957:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971948160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.056983:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971948160:12345-0@lo:400:kworker.0 Request processed in 27us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.056989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:1.0:1787388140.057011:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388140.057015:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388140.057070:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971947648:0@lo:400:kworker.0 00010000:00080000:1.0:1787388140.057087:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e47b80 x1874211971948160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388140.057098:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971948160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.057111:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971947520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.057123:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971948032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.057193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971947264 00000100:00100000:0.0:1787388140.057793:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971947904:12345-0@lo:400:kworker.0 Request processed in 8308us (11142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388140.057803:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787388140.057997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971947264 00000100:00100000:1.0:1787388140.058051:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787388140.058058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971947264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388140.058108:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971947264:12345-0@lo:400:kworker.0 Request processed in 50us (11314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.058115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1787388140.059370:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971948288:12345-0@lo:400:kworker.0 Request processed in 12187us (12488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.059382:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787388140.059453:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971947264:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.059475:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971947776:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.059487:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971948288:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.059503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971947392:0@lo:400:kworker.0 00000100:00100000:2.0:1787388140.059517:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1787388140.059523:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c44eb100, transno 4294967324 00000004:00080000:2.0:1787388140.059551:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1787388140.059580:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971947904:0@lo:400:kworker.0 00010000:00080000:2.0:1787388140.059618:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e46300 x1874211971948416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388140.059631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971948416:0@lo:400:kworker.0 00000100:00100000:3.0:1787388140.380542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388140.380639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388140.380673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388140.380752:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028608 00000100:00100000:0.0:1787388140.380762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028608 00000100:00100000:0.0:1787388140.381073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 392 00000100:00100000:0.0:1787388140.381084:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211953028608:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388140.381161:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2403:x1874211953028608:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 77us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388140.381168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 392 00000100:00100000:3.0:1787388140.391672:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388140.391726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388140.391779:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953029120 00000100:00100000:2.0:1787388140.391789:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953029120 00000100:00100000:2.0:1787388140.391849:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 139 00000100:00100000:2.0:1787388140.391881:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211953029120:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388140.391959:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211953029120:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.391966:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 139 00000100:00100000:1.0:1787388140.392236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028736 00000100:00100000:1.0:1787388140.392261:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028736 00000100:00080000:1.0:1787388140.392282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388140.392350:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388140.392628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028864 00000100:00100000:0.0:1787388140.392632:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028864 00000100:00100000:0.0:1787388140.392675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 338 00000100:00100000:0.0:1787388140.392702:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:2404:x1874211953028736:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388140.392745:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+19:2404:x1874211953028736:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 44us (12213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388140.392761:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 338 00000100:00100000:0.0:1787388140.392775:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 339 00000100:00100000:0.0:1787388140.392780:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211953028864:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388140.392807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2403:x1874211953028864:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 27us (12134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388140.392813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 339 00000100:00080000:2.0:1787388140.392929:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388140.407882:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953029376 00000100:00100000:0.0:1787388140.407897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953029376 00000100:00100000:0.0:1787388140.407981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388140.408112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388140.408137:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953029248 00000100:00100000:2.0:1787388140.408144:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953029248 00000100:00100000:3.0:1787388140.408211:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953028992 00000100:00100000:3.0:1787388140.408217:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953028992 00000100:00100000:1.0:1787388140.408232:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 340 00000100:00100000:1.0:1787388140.408248:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211953029376:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388140.408256:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 140 00000100:00100000:3.0:1787388140.408267:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953028992:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388140.408407:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2404:x1874211953028992:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 141us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.408408:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211953029376:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 163us (16678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388140.408417:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 140 00000100:00100000:1.0:1787388140.408429:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 340 00000100:00080000:3.0:1787388140.408674:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388140.408706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388140.408709:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388140.409847:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 341 00000100:00100000:1.0:1787388140.412945:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211953029248:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388140.413050:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211953029248:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 126us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.413059:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 341 00000100:00100000:0.0:1787388140.432008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388140.432146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953029504 00000100:00100000:2.0:1787388140.432156:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953029504 00000100:00100000:2.0:1787388140.432265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 255 00000100:00100000:2.0:1787388140.432277:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+19:12197:x1874211953029504:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787388140.432384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74df45bd-a066-4da5-9401-b0a043132784+19:12197:x1874211953029504:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.432392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 255 00000100:00100000:3.0:1787388140.439300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388140.439529:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953029632 00000100:00100000:1.0:1787388140.439539:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953029632 00000100:00100000:1.0:1787388140.439603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 256 00000100:00100000:1.0:1787388140.439615:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:12197:x1874211953029632:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787388140.439777:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74df45bd-a066-4da5-9401-b0a043132784+5:12197:x1874211953029632:12345-192.168.204.52@tcp:60:lhsmtool_posix.0 Request processed in 163us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.439785:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 256 00000100:00100000:3.0:1787388140.444295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388140.444512:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953029888 00000100:00100000:1.0:1787388140.444531:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953029888 00000100:00100000:1.0:1787388140.444648:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 65 00000100:00100000:1.0:1787388140.444659:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+19:12197:x1874211953029888:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388140.444962:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+20:12197:x1874211953029888:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 304us (675us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787388140.444986:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 65 00010000:00010000:0.0:1787388140.680279:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388140.721464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388140.721794:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030016 00000100:00100000:2.0:1787388140.721804:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030016 00000100:00100000:2.0:1787388140.721869:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 257 00000100:00100000:2.0:1787388140.721880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:12992:x1874211953030016:12345-192.168.204.52@tcp:101:lsof.0 00010000:00010000:2.0:1787388140.721901:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388140.721922:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1812b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd504e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388140.721985:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b1812b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388140.722000:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b1812b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388140.722026:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b1812b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388140.722075:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388140.722080:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388140.722102:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b1812b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388140.722127:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1812b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd504e expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388140.722160:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b1812b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd504e expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388140.722169:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:2.0:1787388140.722338:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388140.722343:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708c00, rc 0) 00000100:00100000:2.0:1787388140.722406:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:12992:x1874211953030016:12345-192.168.204.52@tcp:101:lsof.0 Request processed in 528us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.722414:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 257 00010000:00010000:1.0:1787388141.704857:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388142.728092:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388143.112192:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388143.112237:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971948544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388143.112335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388143.112570:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948544 00000100:00100000:0.0:1787388143.112580:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948544 00000100:00100000:0.0:1787388143.112668:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787388143.112720:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971948544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388143.112753:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787388143.112809:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971948544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388143.112817:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787388143.113062:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c364ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971948544:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787388143.113210:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388143.113839:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388143.113853:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971948672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388143.113988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388143.114162:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948672 00000100:00100000:2.0:1787388143.114169:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948672 00000100:00100000:2.0:1787388143.114229:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787388143.114254:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971948672:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787388143.114357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787388143.114397:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388143.115859:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971948672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1599us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388143.115881:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787388143.119517:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971948672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388143.624140:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971948800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388143.624215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388143.624435:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948800 00000100:00100000:2.0:1787388143.624445:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948800 00000100:00100000:2.0:1787388143.624564:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787388143.624576:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971948800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388143.624613:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388143.624708:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971948800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388143.624717:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787388143.625046:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971948800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388143.753127:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388144.570344:0:14960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:42:23 (1787388143) 00010000:00010000:0.0:1787388144.777126:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388145.160385:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971949056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388145.160452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388145.160495:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949056 00000100:00100000:1.0:1787388145.160502:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949056 00000100:00100000:2.0:1787388145.160512:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971949568:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160554:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787388145.160563:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971949056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388145.160598:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388145.160618:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388145.160636:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971949056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.160642:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971950080:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160644:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787388145.160662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388145.160694:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971950592:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160697:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949568 00000100:00100000:1.0:1787388145.160700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949568 00000100:00100000:2.0:1787388145.160715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388145.160726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950080 00000100:00100000:1.0:1787388145.160728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950080 00000100:00100000:1.0:1787388145.160747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787388145.160751:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971949056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388145.160753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971949568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.160768:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787388145.160774:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971949184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160781:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971949568:12345-0@lo:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388145.160787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787388145.160815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787388145.160821:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971950080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971950080:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388145.160852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787388145.160871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388145.160889:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971949696:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949184 00000100:00100000:1.0:1787388145.160895:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949184 00000100:00100000:2.0:1787388145.160911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388145.160918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787388145.160924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971949184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.160927:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971950208:0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.160945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388145.160949:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3644:x1874211971949184:12345-0@lo:400:kworker.0 Request processed in 26us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388145.160955:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787388145.160958:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971950720:0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.160976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388145.160996:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950592 00000100:00100000:2.0:1787388145.160997:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971949568:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.160999:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950592 00000100:00100000:2.0:1787388145.161006:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971950080:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.161021:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950720 00000100:00100000:1.0:1787388145.161023:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950720 00000100:00100000:2.0:1787388145.161026:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971949184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.161038:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787388145.161044:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971950592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.161047:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950208 00000100:00100000:2.0:1787388145.161050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950208 00000100:00100000:2.0:1787388145.161075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787388145.161081:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971950208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.161102:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971950592:12345-0@lo:400:kworker.0 Request processed in 57us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.161108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971950208:12345-0@lo:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388145.161109:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787388145.161113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787388145.161120:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787388145.161125:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971950720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.161135:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949696 00000100:00100000:2.0:1787388145.161139:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949696 00000100:00100000:1.0:1787388145.161149:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971950720:12345-0@lo:400:kworker.0 Request processed in 25us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388145.161156:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787388145.161160:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787388145.161165:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971949696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.161195:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971949696:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.161201:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787388145.161241:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971949696:0@lo:400:kworker.0 00010000:00080000:2.0:1787388145.161252:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e47480 x1874211971950208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388145.161261:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971950208:0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.161270:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971950720:0@lo:400:kworker.0 00000100:00100000:2.0:1787388145.161277:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971950592:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.162089:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971948928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388145.162133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162175:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971949440:0@lo:400:kworker.0 00000100:00100000:0.0:1787388145.162182:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971948928 00000100:00100000:0.0:1787388145.162187:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971948928 00000100:00100000:3.0:1787388145.162197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162222:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c44eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971949952:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.162243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162261:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971950464:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.162296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162672:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787388145.162707:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971949312:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.162732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162749:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971949824:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.162769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971950336:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.162818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388145.162831:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971950848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388145.162852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787388145.162888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388145.162892:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388145.162895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388145.162906:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950464 00000100:00100000:3.0:1787388145.162910:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950464 00000100:00100000:3.0:1787388145.162940:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949312 00000100:00100000:3.0:1787388145.162944:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949312 00000100:00100000:3.0:1787388145.162954:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950336 00000100:00100000:3.0:1787388145.162956:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950336 00000100:00100000:3.0:1787388145.162969:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787388145.162976:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971950464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.163034:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971950464:12345-0@lo:400:kworker.0 Request processed in 57us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.163048:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787388145.163063:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787388145.163069:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971949312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.163097:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971949312:12345-0@lo:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.163102:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787388145.163113:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787388145.163118:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971950336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.163143:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971950336:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.163148:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787388145.163164:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949952 00000100:00100000:3.0:1787388145.163168:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949952 00000100:00100000:3.0:1787388145.163184:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949824 00000100:00100000:3.0:1787388145.163187:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949824 00000100:00100000:3.0:1787388145.163199:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787388145.163204:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971949952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.163232:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971949952:12345-0@lo:400:kworker.0 Request processed in 27us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.163239:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787388145.163248:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787388145.163254:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971949824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.163276:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971949824:12345-0@lo:400:kworker.0 Request processed in 22us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.163282:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1787388145.163384:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388145.163388:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388145.163389:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388145.163415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971949312:0@lo:400:kworker.0 00000100:00100000:3.0:1787388145.163426:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971949824:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.163432:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950848 00000100:00100000:3.0:1787388145.163434:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971950336:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.163441:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950848 00000100:00100000:3.0:1787388145.163444:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c44eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971949952:0@lo:400:kworker.0 00010000:00080000:3.0:1787388145.163454:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e44380 x1874211971950464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388145.163463:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971950464:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.163466:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787388145.163472:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971950848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388145.163486:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388145.163527:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971950848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388145.163533:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787388145.163665:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971950848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388145.164969:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971949440 00000100:00100000:0.0:1787388145.164988:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971949440 00000100:00100000:0.0:1787388145.165015:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787388145.165022:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c364ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874211971948928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388145.165051:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787388145.165266:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787388145.165276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874211971949440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388145.166493:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c364ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874211971948928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1464us (4351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388145.166504:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787388145.171408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971949440:12345-0@lo:400:kworker.0 Request processed in 6125us (9199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.171423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787388145.172237:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971948928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388145.172261:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971949440:0@lo:400:kworker.0 00000100:00100000:1.0:1787388145.493941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388145.493992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388145.494023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388145.494061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388145.494169:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030528 00000100:00100000:2.0:1787388145.494181:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030528 00000100:00100000:2.0:1787388145.494243:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:2.0:1787388145.494254:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211953030528:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388145.494328:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+7:2401:x1874211953030528:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 76us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.494336:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:1.0:1787388145.494868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388145.494895:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388145.494916:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388145.494969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030144 00000100:00100000:0.0:1787388145.494976:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030144 00000100:00100000:0.0:1787388145.495016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 394 00000100:00100000:2.0:1787388145.495023:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030272 00000100:00100000:0.0:1787388145.495027:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211953030144:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388145.495030:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030272 00000100:00100000:2.0:1787388145.495077:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030784 00000100:00100000:2.0:1787388145.495090:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030784 00000100:00100000:0.0:1787388145.495090:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211953030144:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 66us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388145.495101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 394 00000100:00100000:2.0:1787388145.495112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030400 00000100:00100000:2.0:1787388145.495115:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030400 00000100:00100000:2.0:1787388145.495133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030912 00000100:00100000:2.0:1787388145.495135:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030912 00000100:00100000:0.0:1787388145.495144:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 348 00000100:00100000:0.0:1787388145.495155:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+20:2401:x1874211953030272:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388145.495160:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 349 00000100:00100000:2.0:1787388145.495170:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211953030784:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388145.495200:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2401:x1874211953030784:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 33us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.495220:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 349 00000100:00100000:2.0:1787388145.495238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 350 00000100:00100000:2.0:1787388145.495243:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211953030400:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388145.495268:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211953030400:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.495273:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 350 00000100:00100000:2.0:1787388145.495283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 351 00000100:00100000:2.0:1787388145.495289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211953030912:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388145.495309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2401:x1874211953030912:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 20us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388145.495315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 351 00000100:00100000:0.0:1787388145.495428:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+20:2401:x1874211953030272:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 276us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388145.495435:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 348 00000100:00080000:3.0:1787388145.496472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388145.496479:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388145.496482:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388145.496495:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953030656 00000100:00100000:3.0:1787388145.496502:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953030656 00000100:00100000:3.0:1787388145.496620:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00100000:3.0:1787388145.496630:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211953030656:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388145.496699:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74df45bd-a066-4da5-9401-b0a043132784+5:2401:x1874211953030656:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 71us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388145.496715:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00080000:2.0:1787388145.497504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787388145.806939:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787388146.186546:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00080000:2.0:1787388146.186581:0:6499:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787388146.186674:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787388146.186709:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787388146.824413:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388147.848415:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388148.232282:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388148.232306:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971950976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388148.232384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388148.232790:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971950976 00000100:00100000:2.0:1787388148.232799:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971950976 00000100:00100000:2.0:1787388148.232852:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787388148.232862:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971950976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388148.232890:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388148.232941:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971950976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388148.232963:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787388148.232987:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388148.233027:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971950976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388148.233171:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388148.233182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971951104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388148.233226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388148.233458:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951104 00000100:00100000:2.0:1787388148.233463:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951104 00000100:00100000:2.0:1787388148.233504:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787388148.233513:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971951104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388148.233542:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388148.233580:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971951104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388148.233586:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787388148.233617:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971951104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787388148.233717:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787388148.426710:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388148.515662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388148.515880:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953031168 00000100:00100000:2.0:1787388148.515891:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953031168 00000100:00100000:2.0:1787388148.516006:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00100000:2.0:1787388148.516018:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+19:13216:x1874211953031168:12345-192.168.204.52@tcp:35:umount.0 00000100:00100000:2.0:1787388148.516363:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+20:13216:x1874211953031168:12345-192.168.204.52@tcp:35:umount.0 Request processed in 346us (710us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787388148.516372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 66 00000100:00080000:0.0:1787388148.516582:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388148.521356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388148.521535:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953031424 00000100:00100000:2.0:1787388148.521546:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953031424 00000100:00100000:2.0:1787388148.521664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:2.0:1787388148.521676:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+20:13216:x1874211953031424:12345-192.168.204.52@tcp:35:umount.0 00000100:00100000:2.0:1787388148.522350:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+21:13216:x1874211953031424:12345-192.168.204.52@tcp:35:umount.0 Request processed in 673us (1000us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787388148.522360:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 67 00000100:00100000:0.0:1787388148.527925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388148.528181:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953031680 00000100:00100000:3.0:1787388148.528323:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953031680 00000100:00100000:3.0:1787388148.528392:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:3.0:1787388148.528404:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927401b3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+21:13216:x1874211953031680:12345-192.168.204.52@tcp:35:umount.0 00000100:00100000:3.0:1787388148.528927:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927401b3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74df45bd-a066-4da5-9401-b0a043132784+22:13216:x1874211953031680:12345-192.168.204.52@tcp:35:umount.0 Request processed in 524us (1014us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787388148.528935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 68 00000100:00100000:0.0:1787388148.535360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388148.535463:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953031936 00000100:00100000:2.0:1787388148.535491:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953031936 00000100:00100000:2.0:1787388148.535741:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:2.0:1787388148.535753:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+22:13216:x1874211953031936:12345-192.168.204.52@tcp:35:umount.0 00000100:00100000:2.0:1787388148.536171:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74df45bd-a066-4da5-9401-b0a043132784+23:13216:x1874211953031936:12345-192.168.204.52@tcp:35:umount.0 Request processed in 420us (822us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787388148.536180:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 69 00000100:00100000:0.0:1787388148.540957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388148.541147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388148.541271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388148.541506:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953032192 00000100:00100000:1.0:1787388148.541517:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953032192 00000100:00100000:1.0:1787388148.541600:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953032448 00000100:00100000:1.0:1787388148.541603:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953032448 00000100:00100000:1.0:1787388148.541635:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:1.0:1787388148.541645:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+14:2401:x1874211953032192:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388148.541673:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388148.541732:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23ff200/0x5cb77467b1811b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ba1 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.541751:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388148.541815:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+13:2401:x1874211953032192:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 171us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388148.541823:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:1.0:1787388148.541843:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787388148.541850:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+12:2401:x1874211953032448:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388148.541858:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388148.541868:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1496600/0x5cb77467b1811d8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c7a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.541876:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388148.541893:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2401:x1874211953032448:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 44us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388148.541899:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:0.0:1787388148.543922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388148.544008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953032320 00000100:00100000:3.0:1787388148.544027:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953032320 00000100:00100000:1.0:1787388148.544387:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787388148.544401:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2401:x1874211953032320:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388148.544415:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388148.544436:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a200/0x5cb77467b1811a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4b62 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.544454:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388148.544511:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2401:x1874211953032320:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 113us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388148.545729:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:2.0:1787388148.545959:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953032064 00000100:00100000:2.0:1787388148.545969:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953032064 00000100:00100000:2.0:1787388148.546043:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 83 00000100:00100000:2.0:1787388148.546054:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+5:2400:x1874211953032064:12345-192.168.204.52@tcp:9:umount.0 00000020:00000080:2.0:1787388148.546081:0:10361:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811e57 00000100:00080000:2.0:1787388148.546090:0:10361:0:(import.c:65:import_set_state_nolock()) ffff9273ffb3c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388148.546134:0:10361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787388148.546282:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74df45bd-a066-4da5-9401-b0a043132784+2:2400:x1874211953032064:12345-192.168.204.52@tcp:9:umount.0 Request processed in 230us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388148.546289:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 83 00010000:00010000:2.0:1787388148.546307:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388148.547062:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388148.551264:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388148.551386:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953032832 00000100:00100000:3.0:1787388148.551396:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953032832 00000100:00100000:3.0:1787388148.551470:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 84 00000100:00100000:3.0:1787388148.551481:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+7:2400:x1874211953032832:12345-192.168.204.52@tcp:9:umount.0 00000020:00000080:3.0:1787388148.551512:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18120cd 00000020:00010000:3.0:1787388148.551534:0:8435:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9273c8ad7800: total 0 00000100:00080000:3.0:1787388148.551540:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9273c8ad7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787388148.551589:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1787388148.551801:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74df45bd-a066-4da5-9401-b0a043132784+5:2400:x1874211953032832:12345-192.168.204.52@tcp:9:umount.0 Request processed in 319us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388148.551830:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 84 00000020:00010000:3.0:1787388148.551856:0:10341:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9273c8ad7800: total 0 00010000:00010000:3.0:1787388148.551880:0:10341:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9273c8ad7800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787388148.551935:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51ee777/0x5cb77467b1812b54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5047 expref: 4 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388148.551974:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032ecc051/0x5cb77467b1812485 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e64 expref: 3 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388148.552001:0:10341:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9273c8ad7800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787388148.552013:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388148.552015:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388148.552017:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388148.553838:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787388148.558539:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388148.558552:0:13804:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388148.558661:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787388148.558667:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388148.558908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388148.558972:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953033856 00000100:00100000:2.0:1787388148.558982:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953033856 00000100:00100000:2.0:1787388148.559057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 258 00000100:00100000:2.0:1787388148.559066:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+23:2400:x1874211953033856:12345-192.168.204.52@tcp:39:umount.0 00000020:00000080:2.0:1787388148.559100:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a8a 00000020:00010000:2.0:1787388148.559155:0:6521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9272c36cf000: total 0 00000100:00080000:2.0:1787388148.559160:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9272c36cc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388148.559186:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1787388148.559353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74df45bd-a066-4da5-9401-b0a043132784+22:2400:x1874211953033856:12345-192.168.204.52@tcp:39:umount.0 Request processed in 286us (448us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1787388148.559380:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 258 00000020:00010000:1.0:1787388148.559658:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9272c36cf000: total 0 00010000:00010000:1.0:1787388148.559759:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9272c36cf000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1787388148.559809:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388148.559814:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388148.559823:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe600/0x5cb77467b1812128 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4d7d expref: 21 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.559852:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388148.559862:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388148.559868:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497400/0x5cb77467b1812a35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ffa expref: 20 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.559882:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388148.559892:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388148.559896:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffc00/0x5cb77467b1812b2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5039 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.559934:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:1.0:1787388148.559942:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787388148.559947:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fec00/0x5cb77467b181250a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e87 expref: 18 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.559961:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388148.559971:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388148.559983:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe400/0x5cb77467b1812b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5032 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560008:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388148.560012:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388148.560016:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b5c00/0x5cb77467b1812366 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e17 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560047:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9273fbd42700) 00010000:00010000:1.0:1787388148.560050:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388148.560059:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b1811db6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c88 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560084:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9273da1a0f00) 00010000:00010000:1.0:1787388148.560087:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388148.560090:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496400/0x5cb77467b18127f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4f60 expref: 14 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560105:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:1.0:1787388148.560108:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388148.560112:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23ffe00/0x5cb77467b18124ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e80 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560125:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9273e13c5f00) 00010000:00010000:1.0:1787388148.560127:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388148.560130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1812b3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5040 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560161:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9273d8f07200) 00010000:00010000:1.0:1787388148.560164:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787388148.560169:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fe000/0x5cb77467b1811e2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ca4 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560185:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388148.560188:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388148.560191:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c23fee00/0x5cb77467b1812470 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e5d expref: 10 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560204:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273d13bda00) 00010000:00010000:1.0:1787388148.560206:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388148.560209:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4400/0x5cb77467b1811dd2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c8f expref: 9 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560225:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9273c39fce00) 00010000:00010000:1.0:1787388148.560227:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388148.560231:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273e76b4200/0x5cb77467b1812446 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4e4f expref: 8 pid: 13489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388148.560243:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9272c36cf000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787388148.560258:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388148.560260:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388148.560262:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388148.570539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388148.570750:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953033984 00000100:00100000:0.0:1787388148.570760:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953033984 00000100:00100000:0.0:1787388148.570827:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 259 00000100:00100000:0.0:1787388148.570838:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+5:2400:x1874211953033984:12345-192.168.204.52@tcp:39:umount.0 00000020:00000080:0.0:1787388148.570872:0:13489:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a91 00000100:00080000:0.0:1787388148.570889:0:13489:0:(import.c:65:import_set_state_nolock()) ffff9272c2f64000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388148.570961:0:13489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1787388148.570982:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787388148.571010:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388148.571203:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74df45bd-a066-4da5-9401-b0a043132784+3:2400:x1874211953033984:12345-192.168.204.52@tcp:39:umount.0 Request processed in 365us (685us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787388148.571212:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 259 00000100:00100000:3.0:1787388148.744320:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388148.744346:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971951232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388148.744461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388148.744730:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951232 00000100:00100000:0.0:1787388148.744740:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951232 00000100:00100000:0.0:1787388148.744798:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787388148.744808:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f6b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971951232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388148.744843:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388148.745133:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f6b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971951232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 325us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388148.745142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787388148.745919:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971951232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787388148.876310:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388149.896188:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388150.280097:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971951360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388150.280220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.280544:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971951488:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.280585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.280607:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971952000:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.280631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.280646:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971952512:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.280667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.280708:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388150.280714:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971951872:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.280753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281015:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971952384:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281040:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281059:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971952896:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281104:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971951744:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281157:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971952256:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281188:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971952768:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281224:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787388150.281230:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971951616:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281264:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971952128:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281316:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971952640:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.281335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388150.281357:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952512 00000100:00100000:1.0:1787388150.281364:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952512 00000100:00100000:1.0:1787388150.281408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951872 00000100:00100000:1.0:1787388150.281411:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951872 00000100:00100000:1.0:1787388150.281422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952384 00000100:00100000:1.0:1787388150.281424:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952384 00000100:00100000:1.0:1787388150.281434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952768 00000100:00100000:1.0:1787388150.281437:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952768 00000100:00100000:3.0:1787388150.281586:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951616 00000100:00100000:3.0:1787388150.281590:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951616 00000100:00100000:3.0:1787388150.281607:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952640 00000100:00100000:3.0:1787388150.281615:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952640 00000100:00100000:3.0:1787388150.281632:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787388150.281639:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971952512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.281707:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211971952512:12345-0@lo:400:kworker.0 Request processed in 67us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.281715:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787388150.281732:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787388150.281738:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971951872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.282109:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971951872:12345-0@lo:400:kworker.0 Request processed in 25us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.282117:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787388150.282134:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787388150.282142:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971952384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.282175:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971952384:12345-0@lo:400:kworker.0 Request processed in 35us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.282181:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787388150.282192:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787388150.282198:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971951616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.282233:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971951616:12345-0@lo:400:kworker.0 Request processed in 35us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.282238:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787388150.282250:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787388150.282256:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971952640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.282283:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874211971952640:12345-0@lo:400:kworker.0 Request processed in 27us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.282301:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787388150.282323:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952896 00000100:00100000:3.0:1787388150.282327:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952896 00000100:00100000:3.0:1787388150.282353:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952256 00000100:00100000:3.0:1787388150.282355:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952256 00000100:00100000:3.0:1787388150.282364:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952128 00000100:00100000:3.0:1787388150.282367:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952128 00000100:00100000:3.0:1787388150.282379:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787388150.282385:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971952896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.282417:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971952896:12345-0@lo:400:kworker.0 Request processed in 31us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.282423:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787388150.282433:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388150.282439:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971952256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.282589:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951488 00000100:00100000:2.0:1787388150.282595:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951488 00000100:00100000:2.0:1787388150.282626:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787388150.282632:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971951488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.282668:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3647:x1874211971951488:12345-0@lo:400:kworker.0 Request processed in 36us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388150.282674:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787388150.282733:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971952000 00000100:00100000:2.0:1787388150.282737:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971952000 00000100:00100000:2.0:1787388150.282758:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951744 00000100:00100000:2.0:1787388150.282989:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951744 00000100:00100000:2.0:1787388150.283011:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787388150.283016:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971952000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.283049:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971952000:12345-0@lo:400:kworker.0 Request processed in 34us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388150.283055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787388150.283066:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787388150.283071:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971951744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.283097:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971951744:12345-0@lo:400:kworker.0 Request processed in 26us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388150.283102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787388150.283121:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971951360 00000100:00100000:2.0:1787388150.283125:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971951360 00000100:00100000:2.0:1787388150.283150:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787388150.283156:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971951360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388150.283184:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388150.283219:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971951360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388150.283227:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787388150.283246:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787388150.283253:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971952128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.283282:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971952128:12345-0@lo:400:kworker.0 Request processed in 31us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388150.283288:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787388150.283364:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971953024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388150.283398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388150.283438:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971951872:0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.283581:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971952256:12345-0@lo:400:kworker.0 Request processed in 1141us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.283588:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388150.283621:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971951616:0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.283634:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971952128:0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.283644:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874211971952640:0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.283655:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971951744:0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.283665:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971952256:0@lo:400:kworker.0 00000100:00100000:3.0:1787388150.283719:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953024 00000100:00100000:3.0:1787388150.283722:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953024 00000100:00100000:3.0:1787388150.283755:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787388150.283909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787388150.283916:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971952768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.283958:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211971952768:12345-0@lo:400:kworker.0 Request processed in 42us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388150.283964:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:1.0:1787388150.283985:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388150.283989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388150.283991:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388150.283993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787388150.284013:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2f75f80 x1874211971952768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388150.284025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971952768:0@lo:400:kworker.0 00000100:00100000:1.0:1787388150.284062:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971951360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388150.284659:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388150.284671:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971953152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388150.284735:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388150.284870:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953152 00000100:00100000:0.0:1787388150.284876:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953152 00000100:00100000:0.0:1787388150.284909:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787388150.284916:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971953152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388150.284934:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388150.284984:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971953152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388150.284990:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787388150.285028:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971953152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388150.285235:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971953024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388150.285281:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787388150.285319:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971953024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1557us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.285325:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787388150.285524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971952384:0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.285540:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971952896:0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.285550:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971951488:0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.285563:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971952000:0@lo:400:kworker.0 00010000:00080000:2.0:1787388150.285576:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c2f74e00 x1874211971952512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388150.285585:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211971952512:0@lo:400:kworker.0 00000100:00100000:2.0:1787388150.285618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971953024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388150.615488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388150.615725:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953034240 00000100:00100000:3.0:1787388150.615736:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953034240 00000100:00100000:3.0:1787388150.615836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 358 00000100:00100000:3.0:1787388150.615848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2403:x1874211953034240:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388150.615998:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2403:x1874211953034240:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 152us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.616007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 358 00000100:00100000:3.0:1787388150.616057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388150.616176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388150.616201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953034368 00000100:00100000:3.0:1787388150.616205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953034368 00000100:00100000:3.0:1787388150.616236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 359 00000100:00100000:3.0:1787388150.616244:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211953034368:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388150.616277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2403:x1874211953034368:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.616284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 359 00000100:00080000:0.0:1787388150.616461:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388150.616466:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388150.616477:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953034112 00000100:00100000:0.0:1787388150.616491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953034112 00000100:00100000:0.0:1787388150.616525:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 396 00000100:00100000:0.0:1787388150.616532:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211953034112:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388150.616561:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8423a62-2514-4436-ad30-fa5cd6699d5c+10:2403:x1874211953034112:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388150.616568:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 396 00000100:00100000:3.0:1787388150.704250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388150.704308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388150.704542:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953034624 00000100:00100000:1.0:1787388150.704553:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953034624 00000100:00100000:1.0:1787388150.704629:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953034496 00000100:00100000:1.0:1787388150.704633:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953034496 00000100:00100000:1.0:1787388150.704733:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:1.0:1787388150.704743:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2404:x1874211953034624:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388150.704760:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787388150.704843:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:3.0:1787388150.704854:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8423a62-2514-4436-ad30-fa5cd6699d5c+11:2404:x1874211953034496:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388150.704873:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388150.704898:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafac00/0x5cb77467b1811b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4bb6 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388150.704920:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388150.705050:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafae00/0x5cb77467b1811b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4be7 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388150.705062:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388150.705105:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8423a62-2514-4436-ad30-fa5cd6699d5c+9:2404:x1874211953034496:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 252us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388150.705114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:1.0:1787388150.717292:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:2404:x1874211953034624:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 12534us (13036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388150.717310:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:2.0:1787388150.729161:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388150.729235:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953034752 00000100:00100000:1.0:1787388150.729248:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953034752 00000100:00100000:2.0:1787388150.729253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388150.729310:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035008 00000100:00100000:2.0:1787388150.729315:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035008 00000100:00100000:1.0:1787388150.729322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787388150.729336:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8423a62-2514-4436-ad30-fa5cd6699d5c+8:2402:x1874211953034752:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388150.729352:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787388150.729369:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 260 00000100:00100000:2.0:1787388150.729381:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+6:2400:x1874211953035008:12345-192.168.204.52@tcp:39:umount.0 00010000:00010000:1.0:1787388150.729387:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1497c00/0x5cb77467b1811d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4c73 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388150.729408:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1787388150.729418:0:13489:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811ba9 00000020:00010000:2.0:1787388150.729427:0:13489:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9272c23f6800: total 0 00000100:00080000:2.0:1787388150.729433:0:13489:0:(import.c:65:import_set_state_nolock()) ffff9272c23f5800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787388150.729469:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8423a62-2514-4436-ad30-fa5cd6699d5c+7:2402:x1874211953034752:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 135us (319us total) trans 0 rc 0/0 00000001:00000004:2.0:1787388150.729474:0:13489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:1.0:1787388150.729490:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000020:00010000:1.0:1787388150.729529:0:10341:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9272c23f6800: total 0 00010000:00010000:1.0:1787388150.729582:0:10341:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9272c23f6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787388150.729611:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273c39fc500) 00010000:00010000:1.0:1787388150.729615:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388150.729621:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708c00/0x5cb77467b1812b62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd504e expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388150.729651:0:10341:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9272c23f6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787388150.729663:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388150.729665:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388150.729667:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388150.730336:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e2df5a-9363-4cf8-8d34-c496b357ff54+3:2400:x1874211953035008:12345-192.168.204.52@tcp:39:umount.0 Request processed in 952us (1081us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1787388150.730346:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 260 00000100:00100000:0.0:1787388150.751516:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388150.751648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035136 00000100:00100000:3.0:1787388150.751710:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035136 00000100:00100000:3.0:1787388150.751800:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 261 00000100:00100000:3.0:1787388150.751823:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+5:2400:x1874211953035136:12345-192.168.204.52@tcp:39:umount.0 00000020:00000080:3.0:1787388150.751882:0:6520:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811ba2 00000100:00080000:3.0:1787388150.751892:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9273fbf21800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787388150.751923:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1787388150.751953:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388150.752182:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e2df5a-9363-4cf8-8d34-c496b357ff54+3:2400:x1874211953035136:12345-192.168.204.52@tcp:39:umount.0 Request processed in 357us (673us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787388150.752192:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 261 00000100:00100000:2.0:1787388150.790385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388150.790514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035392 00000100:00100000:0.0:1787388150.790534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035392 00000100:00100000:0.0:1787388150.790602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 397 00000100:00100000:0.0:1787388150.790613:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+7:2400:x1874211953035392:12345-192.168.204.52@tcp:251:umount.0 00000020:00000080:0.0:1787388150.790663:0:6514:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a67 00000020:00010000:0.0:1787388150.790671:0:6514:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9273fbf3b000: total 0 00000100:00080000:0.0:1787388150.790676:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9273fbf3a000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787388150.790788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8423a62-2514-4436-ad30-fa5cd6699d5c+3:2400:x1874211953035392:12345-192.168.204.52@tcp:251:umount.0 Request processed in 176us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388150.790797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 397 00000020:00010000:1.0:1787388150.790804:0:10340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9273fbf3b000: total 0 00010000:00010000:1.0:1787388150.790869:0:10340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9273fbf3b000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787388150.790911:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0030400/0x5cb77467b1811b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd4ba8 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388150.791442:0:10340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9273fbf3b000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787388150.791472:0:10340:0:(genops.c:906:class_export_put()) final put ffff9273fbf3b000/a8423a62-2514-4436-ad30-fa5cd6699d5c 00010000:00010000:0.0:1787388150.791499:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388150.791518:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388150.791520:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787388150.796449:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf3b000/a8423a62-2514-4436-ad30-fa5cd6699d5c for MGS 00000020:00000080:0.0:1787388150.796720:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbf3a000 for MGS 00010000:00010000:2.0:1787388150.921495:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388151.957420:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787388152.502740:0:15157:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787388152.518462:0:15157:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787388152.519306:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.519324:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.519331:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.519339:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.519368:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787388152.519374:0:15157:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787388152.519401:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787388152.519406:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787388152.519412:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787388152.519434:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273eedc4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787388152.519487:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971953280:0@lo:39:umount.0 00000100:00100000:0.0:1787388152.519551:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388152.520028:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388152.520035:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.520060:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273dfafa200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388152.520063:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.520072:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388152.520242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953280 00000100:00100000:2.0:1787388152.520251:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953280 00000100:00100000:2.0:1787388152.520300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787388152.520310:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874211971953280:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787388152.520336:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181167e 00000100:00080000:2.0:1787388152.520344:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9273eee85000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787388152.520408:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1874211971953280:12345-0@lo:39:umount.0 Request processed in 99us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.520415:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1787388152.520426:0:6522:0:(genops.c:906:class_export_put()) final put ffff9273eee83800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787388152.520462:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787388152.520472:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eee83800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787388152.520521:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273eee85000 for lustre-MDT0000 00000100:00080000:2.0:1787388152.520553:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eedc4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787388152.520570:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971953280:0@lo:39:umount.0 00000100:00080000:3.0:1787388152.522545:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388152.522554:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787388152.522561:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:00010000:0.0:1787388152.523247:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388152.523255:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388152.523258:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787388152.523262:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787388152.523300:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.523307:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388152.523338:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.523345:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273dfafa200/0x5cb77467b1811b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388152.523357:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388152.523359:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388152.523361:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388152.523380:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971953408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388152.523437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388152.523581:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953408 00000100:00100000:2.0:1787388152.523589:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953408 00000100:00100000:2.0:1787388152.523644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787388152.523653:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3645:x1874211971953408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388152.523666:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388152.523697:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1482400/0x5cb77467b1811b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811b0f expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.523710:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388152.523742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3645:x1874211971953408:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.523749:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787388152.525058:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971953408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388152.525858:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.525873:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.525879:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.525894:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528211:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388152.528230:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528242:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528250:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528256:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528280:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787388152.528286:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528293:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528298:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528303:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528334:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787388152.528340:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528347:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528354:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528359:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388152.528370:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787388152.528373:0:15157:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787388152.528412:0:15157:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787388152.528417:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787388152.528422:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388152.528428:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787388152.528434:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9272c2423800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388152.528440:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9273fd3b5000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388152.528457:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9273fbc54000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388152.528462:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9273cc6aa800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1787388152.528469:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9272c23f6800 55e2df5a-9363-4cf8-8d34-c496b357ff54 192.168.204.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388152.528474:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9272c36cf000 74df45bd-a066-4da5-9401-b0a043132784 192.168.204.52@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967524 stale:0 00000020:00080000:3.0:1787388152.528479:0:15157:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9273c4a499c0) has exports, disconnecting them 00000020:00080000:3.0:1787388152.528490:0:15157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9272c2423800), last request at 1787388150 00000020:00000080:3.0:1787388152.528498:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181198e 00000100:00080000:3.0:1787388152.528516:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9272c2425800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787388152.528567:0:15157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9272c2423800): rc 0 00000020:00000080:3.0:1787388152.528570:0:15157:0:(genops.c:906:class_export_put()) final put ffff9272c2423800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787388152.528580:0:15157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9273fd3b5000), last request at 1787388150 00000020:00000080:3.0:1787388152.528583:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18118d8 00000100:00080000:3.0:1787388152.528588:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273fd3b6000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787388152.528599:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2423800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787388152.528642:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2425800 for lustre-MDT0000 00000020:00080000:3.0:1787388152.528654:0:15157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273fd3b5000): rc 0 00000020:00000080:3.0:1787388152.528657:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fd3b5000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787388152.528664:0:15157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9273fbc54000), last request at 1787387924 00000020:00000080:3.0:1787388152.528667:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811765 00000100:00080000:3.0:1787388152.528670:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273fbc53800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787388152.528708:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fd3b5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787388152.528731:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fd3b6000 for lustre-MDT0000 00000020:00080000:3.0:1787388152.528743:0:15157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273fbc54000): rc 0 00000020:00000080:3.0:1787388152.528745:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fbc54000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787388152.528752:0:15157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9273cc6aa800), last request at 1787387924 00000020:00000080:3.0:1787388152.528755:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811734 00000100:00080000:3.0:1787388152.528759:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273fbc50000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787388152.528767:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbc54000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787388152.528797:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbc53800 for lustre-MDT0000 00000001:00000004:3.0:1787388152.528807:0:15157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000020:00080000:3.0:1787388152.528884:0:15157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273cc6aa800): rc 0 00000004:00000080:3.0:1787388152.528890:0:15157:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae0cc7b23ae0 00000100:00080000:3.0:1787388152.528924:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388152.528934:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1787388152.529014:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787388152.529022:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529029:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5e00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388152.529033:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529042:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388152.529049:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388152.529056:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388152.529058:0:10340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787388152.529060:0:10340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787388152.529109:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529116:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388152.529304:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529312:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5e00/0x5cb77467b1811b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529323:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787388152.529326:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529331:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388152.529335:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529342:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388152.529348:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388152.529353:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388152.529355:0:10340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787388152.529357:0:10340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787388152.529370:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529376:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388152.529382:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529394:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5200/0x5cb77467b1811a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811a28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529402:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388152.529405:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529410:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388152.529413:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529420:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388152.529426:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388152.529431:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787388152.529433:0:10340:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787388152.529434:0:10340:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787388152.529455:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529461:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388152.529475:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529481:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b4000/0x5cb77467b1811d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811d7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529500:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388152.529503:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529509:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1485c00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388152.529512:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529520:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388152.529526:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388152.529531:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388152.529533:0:10340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787388152.529535:0:10340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787388152.529549:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529554:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388152.529560:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529566:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1485c00/0x5cb77467b18115dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18115e4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.529574:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388152.529576:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388152.529582:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388152.529599:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971953536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388152.529666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388152.529723:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388152.529729:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971953664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388152.529749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388152.529771:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971953792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388152.529788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388152.529801:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388152.529806:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971953920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388152.529819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388152.529842:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953536 00000100:00100000:1.0:1787388152.529847:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953536 00000100:00100000:1.0:1787388152.529876:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953664 00000100:00100000:1.0:1787388152.529878:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953664 00000100:00100000:1.0:1787388152.529886:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953792 00000100:00100000:1.0:1787388152.529888:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953792 00000100:00100000:1.0:1787388152.529896:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971953920 00000100:00100000:1.0:1787388152.529898:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971953920 00010000:00010000:0.0:1787388152.530861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388152.530869:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388152.531030:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388152.531036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388152.531065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787388152.531091:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+26:3646:x1874211971953536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388152.531108:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388152.531126:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1482e00/0x5cb77467b1811b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811b1d expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.531269:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388152.531332:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+25:3646:x1874211971953536:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.531340:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787388152.531362:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388152.531368:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+24:3646:x1874211971953664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388152.531388:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388152.531397:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafb800/0x5cb77467b1811a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811a21 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.531406:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388152.531426:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+23:3646:x1874211971953664:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.531431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388152.531455:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388152.531461:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+22:3644:x1874211971953792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388152.531468:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388152.531477:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1496a00/0x5cb77467b1811d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811d77 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.531485:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388152.531512:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+21:3644:x1874211971953792:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.531518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388152.531534:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388152.531541:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+20:3644:x1874211971953920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388152.531548:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388152.531556:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1483000/0x5cb77467b18115e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b18115dd expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.531565:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388152.531585:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29e41aeb-8af0-4a54-a54e-7e42c8606c3d+19:3644:x1874211971953920:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.531601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388152.531650:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971953664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388152.531660:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971953536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388152.531708:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971953920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388152.531716:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971953792:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787388152.535033:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787388152.535064:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273fb0ef800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787388152.535250:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971954048:0@lo:39:umount.0 00000100:00100000:0.0:1787388152.535321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388152.535858:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954048 00000100:00100000:1.0:1787388152.535867:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954048 00000100:00100000:1.0:1787388152.535923:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787388152.535932:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874211971954048:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787388152.535960:0:7930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18117c7 00000100:00080000:1.0:1787388152.535967:0:7930:0:(import.c:65:import_set_state_nolock()) ffff9273fbeac000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388152.535986:0:7930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1787388152.536226:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787388152.536231:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:3.0:1787388152.536244:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787388152.536312:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787388152.536325:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9272c2371000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787388152.536656:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971954176:0@lo:9:umount.0 00000100:00100000:0.0:1787388152.536716:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388152.536820:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3643:x1874211971954048:12345-0@lo:39:umount.0 Request processed in 888us (1498us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787388152.536829:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00010000:1.0:1787388152.536870:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388152.537036:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954176 00000100:00100000:2.0:1787388152.537041:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954176 00000100:00100000:2.0:1787388152.537174:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787388152.537183:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874211971954176:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787388152.537201:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811902 00000100:00080000:2.0:1787388152.537209:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9272c20d0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388152.537251:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1787388152.537351:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1874211971954176:12345-0@lo:9:umount.0 Request processed in 170us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388152.537357:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1787388152.537406:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388152.537569:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388152.537631:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787388152.537635:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1787388152.537654:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787388152.537730:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787388152.537745:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273fbf3b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787388152.537778:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9273c4a499c0) has no exports 00000100:00080000:0.0:1787388152.538633:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273fb0ef800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787388152.538643:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971954048:0@lo:39:umount.0 00000100:00100000:1.0:1787388152.538756:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971954304:0@lo:9:umount.0 00000100:00100000:1.0:1787388152.538803:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388152.538846:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787388152.538865:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787388152.538867:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388152.538870:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971954176:0@lo:9:umount.0 00000100:00100000:3.0:1787388152.538946:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954304 00000100:00100000:3.0:1787388152.538952:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954304 00000100:00100000:3.0:1787388152.539001:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787388152.539009:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874211971954304:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787388152.539030:0:10361:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a52 00000100:00080000:3.0:1787388152.539038:0:10361:0:(import.c:65:import_set_state_nolock()) ffff9273fbf39800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787388152.539071:0:10361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1787388152.539263:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388152.539415:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3643:x1874211971954304:12345-0@lo:9:umount.0 Request processed in 406us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388152.539423:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787388152.539503:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273fbf3b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787388152.539519:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787388152.539521:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388152.539525:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971954304:0@lo:9:umount.0 00010000:00010000:0.0:1787388152.539626:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787388152.557019:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9273c4a499c0) has no exports 00000020:00000080:0.0:1787388152.616526:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811638 00000020:00000080:0.0:1787388152.616544:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273c31eb800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787388152.616613:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787388152.617086:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388152.617096:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787388152.617101:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff92740195cd40) has no exports 00000020:00000080:1.0:1787388152.617435:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811631 00000020:00000080:1.0:1787388152.617453:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273f13ed000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787388152.617534:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c31eb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787388152.617665:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f13ed000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787388152.618146:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388152.618156:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787388152.618160:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273ea89c000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787388152.618162:0:15157:0:(genops.c:865:class_export_destroy()) destroying export ffff9273ea89c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787388152.618170:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787388152.968160:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388153.351988:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388153.352849:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971954432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388153.352924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388153.353587:0:8951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954432 00000100:00100000:2.0:1787388153.353597:0:8951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954432 00000100:00100000:2.0:1787388153.353672:0:8951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787388153.353702:0:8951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971954432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388153.353730:0:8951:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388153.353807:0:8951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971954432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388153.353815:0:8951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1787388153.353883:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388153.354009:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971954432:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1787388153.874717:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787388153.874739:0:9516:0:(genops.c:906:class_export_put()) final put ffff9273fbf3c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787388153.874768:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:1.0:1787388153.874771:0:9516:0:(genops.c:906:class_export_put()) final put ffff9273ffb3b800/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:3.0:1787388153.874880:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf3c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787388153.874931:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273ffb3b800/74df45bd-a066-4da5-9401-b0a043132784 for lustre-OST0001 00000020:00000080:3.0:1787388153.874956:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbf39800 for lustre-OST0001 00000020:00000080:3.0:1787388153.874961:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273ffb3c000 for lustre-OST0001 00000001:00100000:0.0:1787388153.875312:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787388153.875324:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1787388153.875328:0:7451:0:(genops.c:906:class_export_put()) final put ffff9273eef1b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787388153.875344:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000001:00080000:0.0:1787388153.875349:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1787388153.875351:0:7451:0:(genops.c:906:class_export_put()) final put ffff9273fbf24800/55e2df5a-9363-4cf8-8d34-c496b357ff54 00000001:00100000:0.0:1787388153.875356:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000001:00080000:0.0:1787388153.875360:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1787388153.875362:0:7451:0:(genops.c:906:class_export_put()) final put ffff9272c2f63000/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:3.0:1787388153.875408:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eef1b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787388153.875460:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf24800/55e2df5a-9363-4cf8-8d34-c496b357ff54 for lustre-MDT0001 00000020:00000080:3.0:1787388153.875498:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2f63000/74df45bd-a066-4da5-9401-b0a043132784 for lustre-MDT0001 00000020:00000080:3.0:1787388153.875517:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbeac000 for lustre-MDT0001 00000020:00000080:3.0:1787388153.875522:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbf21800 for lustre-MDT0001 00000020:00000080:3.0:1787388153.875525:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2f64000 for lustre-MDT0001 00000001:00100000:2.0:1787388153.875999:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787388153.876004:0:8429:0:(genops.c:906:class_export_put()) final put ffff9272c20d5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787388153.876024:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:2.0:1787388153.876027:0:8429:0:(genops.c:906:class_export_put()) final put ffff9273c8ad7800/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:3.0:1787388153.876074:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c20d5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787388153.876108:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c8ad7800/74df45bd-a066-4da5-9401-b0a043132784 for lustre-OST0000 00000020:00000080:3.0:1787388153.876125:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c20d0800 for lustre-OST0000 00000020:00000080:3.0:1787388153.876129:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273c8ad7000 for lustre-OST0000 00000001:00100000:1.0:1787388153.876592:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787388153.876597:0:6499:0:(genops.c:906:class_export_put()) final put ffff9273cc6aa800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787388153.876668:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55e2df5a-9363-4cf8-8d34-c496b357ff54 00000001:00080000:1.0:1787388153.876676:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000020:00000080:1.0:1787388153.876698:0:6499:0:(genops.c:906:class_export_put()) final put ffff9272c23f6800/55e2df5a-9363-4cf8-8d34-c496b357ff54 00000020:00000080:0.0:1787388153.880339:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273cc6aa800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787388153.880604:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbc50000 for lustre-MDT0000 00000001:00100000:1.0:1787388153.881309:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74df45bd-a066-4da5-9401-b0a043132784 00000001:00080000:1.0:1787388153.881318:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1787388153.881329:0:6499:0:(genops.c:906:class_export_put()) final put ffff9272c36cf000/74df45bd-a066-4da5-9401-b0a043132784 00000020:00000080:0.0:1787388153.881593:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c23f6800/55e2df5a-9363-4cf8-8d34-c496b357ff54 for lustre-MDT0000 00000020:00000080:0.0:1787388153.881633:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c36cf000/74df45bd-a066-4da5-9401-b0a043132784 for lustre-MDT0000 00000020:00000080:0.0:1787388153.881655:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c23f5800 for lustre-MDT0000 00000020:00000080:0.0:1787388153.881675:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c36cc000 for lustre-MDT0000 00010000:00010000:2.0:1787388153.992675:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787388154.632294:0:15157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9273fbe7a120 - data ffff9273c5f16438/ffff9272c36ba800 00000020:01000000:1.0:1787388154.632486:0:15157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff927401a3e420 - data ffff9273c5d82870/ffff9273f4fd4c00 00000001:00000004:1.0:1787388154.643184:0:15157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000100:00080000:2.0:1787388154.703982:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787388154.703993:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787388154.704012:0:15157:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9273ffa7f800 x1874211971954048/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787388162 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388154.704220:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787388154.713506:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787388154.713515:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:2.0:1787388154.713533:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388154.713536:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787388154.714348:0:8462:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787388154.714354:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787388154.714366:0:8462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787388154.715044:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787388154.715048:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1787388154.715066:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388154.715070:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787388154.718116:0:9920:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787388154.718124:0:9920:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787388154.718149:0:9920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787388154.719241:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811600 00000020:00000080:2.0:1787388154.719252:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273c9f14000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787388154.719901:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9f14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787388154.721566:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811615 00000020:00000080:2.0:1787388154.721582:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273f1c02800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787388154.721604:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787388154.721610:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388154.721619:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787388154.721623:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9273c4a4cd40) has no exports 00000020:00000080:3.0:1787388154.721763:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f1c02800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787388154.721940:0:15157:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787388154.721958:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a4b 00000020:00000080:2.0:1787388154.721964:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fbf3f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787388154.722017:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787388154.722021:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388154.722031:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787388154.722043:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9273ff944d40) has no exports 00000020:00000080:2.0:1787388154.722050:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a44 00000020:00000080:2.0:1787388154.722055:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fbf3f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787388154.722303:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf3f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1787388154.722946:0:15157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787388154.722951:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787388154.722956:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1787388154.722962:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388154.722963:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388154.723004:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388154.723014:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388154.723022:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18118b5 00000020:00000080:2.0:1787388154.723031:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fd3b1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787388154.723044:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787388154.723049:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388154.723053:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787388154.723056:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9273d0f40000) has no exports 00000020:00000080:2.0:1787388154.723061:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811892 00000020:00000080:2.0:1787388154.723064:0:15157:0:(genops.c:906:class_export_put()) final put ffff9272c2376800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787388154.723666:0:15157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787388154.723671:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787388154.723673:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:2.0:1787388154.723782:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388154.723784:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388154.723810:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388154.723816:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787388154.723829:0:15157:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787388154.723835:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18117c0 00000020:00000080:2.0:1787388154.723850:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fbc51000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787388154.723922:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787388154.723927:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388154.723932:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787388154.723935:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9273eedfcd40) has no exports 00000020:00000080:2.0:1787388154.723941:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18117b9 00000020:00000080:2.0:1787388154.723945:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273fb0ee800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787388154.724985:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf3f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388154.725011:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbf3b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787388154.725020:0:36:0:(genops.c:906:class_export_put()) final put ffff9273fbf3d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388154.725022:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf3d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787388154.725026:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388154.725312:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fd3b1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787388154.725330:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2376800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388154.725334:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2371000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787388154.725339:0:36:0:(genops.c:906:class_export_put()) final put ffff9272c2373800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388154.725341:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2373800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787388154.725344:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388154.725373:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbc51000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787388154.725378:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb0ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787388154.725757:0:15157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1787388154.725763:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388154.725766:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787388154.725772:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787388154.725830:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388154.725841:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388154.725875:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388154.725879:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388154.725883:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273cc6ad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388154.725885:0:15157:0:(genops.c:865:class_export_destroy()) destroying export ffff9273cc6ad800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787388154.725889:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787388154.725933:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fb0ef800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787388154.725941:0:36:0:(genops.c:906:class_export_put()) final put ffff9273fb0eb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787388154.725943:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb0eb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787388154.725951:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181161c 00000020:01000000:0.0:1787388154.725954:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388154.725957:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273f1c00800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787388154.725965:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787388154.725968:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388154.725973:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787388154.725977:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9273c4a4b380) has no exports 00000020:00000080:0.0:1787388154.726005:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f1c00800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787388154.726008:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388154.726011:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787388154.726013:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273cc6af800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787388154.726015:0:15157:0:(genops.c:865:class_export_destroy()) destroying export ffff9273cc6af800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787388154.726019:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787388154.727003:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811623 00000020:00000080:3.0:1787388154.727012:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273f1c05800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787388154.727321:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f1c05800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1787388154.727598:0:15157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273c9714000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787388154.727604:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273c9714000 3 00000020:01000004:3.0:1787388154.727608:0:15157:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9273c9714000 from lustre-MDT0000 00000020:00000080:3.0:1787388154.727636:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388154.727645:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787388154.727648:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273c9f10000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787388154.727650:0:15157:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9f10000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787388154.727658:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787388154.727723:0:15157:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1787388154.727728:0:15157:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787388154.727731:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787388154.727734:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388154.727738:0:15157:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787388154.727744:0:15157:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9273c97b9800 29e41aeb-8af0-4a54-a54e-7e42c8606c3d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388154.727751:0:15157:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff927401958000) has exports, disconnecting them 00000020:00080000:3.0:1787388154.727756:0:15157:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9273c97b9800), last request at 1787387906 00000020:00000080:3.0:1787388154.727769:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18115c1 00000020:00010000:3.0:1787388154.727773:0:15157:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9273c97b9800: total 0 00000100:00080000:3.0:1787388154.727777:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9273c97b8000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787388154.727796:0:15157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273c97b9800): rc 0 00000020:00080000:3.0:1787388154.727802:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff927401958000) has no exports 00000100:00100000:3.0:1787388154.727897:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9273df99f400:6515] 2 exiting: rc = 0 00000020:00010000:0.0:1787388154.728396:0:10340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9273c97b9800: total 0 00010000:00010000:0.0:1787388154.728412:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388154.728455:0:10340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9273c97b9800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787388154.728485:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafb000/0x5cb77467b1811aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811ae5 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728502:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a400/0x5cb77467b1811afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811af3 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728515:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1485e00/0x5cb77467b18116cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b18116c4 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728529:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafbe00/0x5cb77467b1811d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811d4d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728540:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1497000/0x5cb77467b1811d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811d5b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728549:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152be00/0x5cb77467b1811b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811b01 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728582:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1482000/0x5cb77467b18116bd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b18116b6 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728594:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe200/0x5cb77467b1811d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811d69 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728607:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273e76b5000/0x5cb77467b18119e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b18119db expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728619:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1483600/0x5cb77467b1811b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811b2b expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728632:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c152a600/0x5cb77467b1811ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811abb expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728642:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafaa00/0x5cb77467b1811ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811ac9 expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728652:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273dfafa000/0x5cb77467b1811ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5cb77467b1811ad7 expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388154.728662:0:10340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9273c97b9800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787388154.728693:0:10340:0:(genops.c:906:class_export_put()) final put ffff9273c97b9800/29e41aeb-8af0-4a54-a54e-7e42c8606c3d 00010000:00010000:0.0:1787388154.728709:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388154.728711:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388154.728713:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388154.728752:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9273d0f27600:6514] 1 exiting: rc = 0 00000020:00000080:3.0:1787388154.728818:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c97b9800/29e41aeb-8af0-4a54-a54e-7e42c8606c3d for MGS 00000020:00000080:3.0:1787388154.728856:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273c97b8000 for MGS 00000100:00100000:3.0:1787388154.730837:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9273df99e800:6513] 0 exiting: rc = 1 00000100:00100000:0.0:1787388154.731010:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731019:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731025:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731042:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731048:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731054:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731061:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731066:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731072:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731078:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731084:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731090:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731095:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731101:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731107:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731113:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731119:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731125:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731130:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731136:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731141:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731146:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731151:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731157:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731164:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731172:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731178:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731184:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731190:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731194:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731200:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731205:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731210:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731216:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731222:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731227:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731232:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731237:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731250:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731255:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731261:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731266:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731271:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731288:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731294:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731300:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731306:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731312:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731317:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731323:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731328:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731334:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731340:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731346:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731351:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731356:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731361:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731367:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731372:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731377:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731381:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731388:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731393:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388154.731407:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787388154.732262:0:15157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff927401afc180 - data ffff9273c5eed870/ffff9272c3621000 00000020:01000000:0.0:1787388154.732412:0:15157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9273ca1321e0 - data ffff9273c5c66af8/ffff9273dfa3f400 00000020:00000080:0.0:1787388154.732886:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18115a5 00000020:00000080:0.0:1787388154.732896:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273d0644000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787388154.732914:0:15157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273c9714000 from MGS, refs=2 00000020:01000004:0.0:1787388154.732918:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273c9714000 2 00000020:01000004:0.0:1787388154.732921:0:15157:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9273c9714000 from MGS 00000020:00000080:0.0:1787388154.732944:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388154.732962:0:15157:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787388154.732965:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273c9713000/MGS 00000020:00000080:0.0:1787388154.732968:0:15157:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9713000/MGS for MGS 00000020:01000000:0.0:1787388154.732975:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787388154.733042:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787388154.733046:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388154.733052:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787388154.733059:0:15157:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9273f1c07000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787388154.733064:0:15157:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9273eedfb380) has exports, disconnecting them 00000020:00080000:0.0:1787388154.733068:0:15157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9273f1c07000), last request at 1787387906 00000020:00000080:0.0:1787388154.733071:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811670 00000020:00080000:0.0:1787388154.733081:0:15157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273f1c07000): rc 0 00000020:00000080:0.0:1787388154.733086:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273f1c07000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787388154.733995:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273d0644000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388154.734011:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f1c07000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787388154.774951:0:15157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787388154.774960:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787388154.774964:0:15157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787388154.774972:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388154.775157:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388154.775167:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787388154.775175:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273c9714000 1 00000020:00000080:0.0:1787388154.775181:0:15157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811597 00000020:00000080:0.0:1787388154.775190:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273c9711000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787388154.775195:0:15157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787388154.775203:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388154.775207:0:15157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787388154.775210:0:15157:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff92740195b380) has no exports 00000020:00000080:3.0:1787388154.775971:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273eedc4800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787388154.775990:0:36:0:(genops.c:906:class_export_put()) final put ffff9273d0374800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787388154.775993:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273d0374800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787388154.776005:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787388154.776089:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9711000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787388154.854449:0:15157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388154.854463:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787388154.854469:0:15157:0:(genops.c:906:class_export_put()) final put ffff9273c9711800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787388154.854474:0:15157:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9711800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787388154.854481:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787388154.854608:0:15157:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9273c9713800 00000020:02000400:0.0:1787388154.854669:0:15157:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787388155.017026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388155.406190:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971954560:0@lo:400:kworker.0 00000400:00000100:0.0:1787388155.406243:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211971954560 offset 0 length 224: 4 00000100:00100000:0.0:1787388155.406286:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971955072:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406338:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971955584:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406398:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787388155.406405:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971954944:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406445:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971955456:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406491:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971954688:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406532:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971955200:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406568:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971955712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388155.406588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406607:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787388155.406612:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971954816:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406648:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971955328:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.406666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388155.406746:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955072 00000100:00100000:0.0:1787388155.406754:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955072 00000100:00100000:0.0:1787388155.406788:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955456 00000100:00100000:0.0:1787388155.406793:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955456 00000100:00100000:1.0:1787388155.407472:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955200 00000100:00100000:1.0:1787388155.407478:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955200 00000100:00100000:1.0:1787388155.407514:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954816 00000100:00100000:1.0:1787388155.407517:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954816 00000100:00100000:1.0:1787388155.407527:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955328 00000100:00100000:1.0:1787388155.407530:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955328 00000100:00100000:1.0:1787388155.407543:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787388155.407552:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971955200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388155.407633:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971955200:12345-0@lo:400:kworker.0 Request processed in 81us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388155.407640:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787388155.407658:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787388155.407662:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874211971955072:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787388155.407668:0:9533:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787388155.407720:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874211971955072:12345-0@lo:400:kworker.0 Request processed in 56us (1403us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787388155.407726:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787388155.407739:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787388155.407743:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874211971954816:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787388155.407757:0:9533:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787388155.407781:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874211971954816:12345-0@lo:400:kworker.0 Request processed in 36us (1148us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787388155.407787:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787388155.410059:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787388155.410068:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971955456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.410141:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971955456:12345-0@lo:400:kworker.0 Request processed in 73us (3676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388155.410147:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787388155.410164:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787388155.410168:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1874211971955328:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787388155.410174:0:13489:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787388155.410199:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1874211971955328:12345-0@lo:400:kworker.0 Request processed in 30us (3532us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787388155.410205:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787388155.410226:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955584 00000100:00100000:0.0:1787388155.410232:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955584 00000100:00100000:0.0:1787388155.410269:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954944 00000100:00100000:0.0:1787388155.410272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954944 00000100:00100000:0.0:1787388155.410294:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787388155.410300:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971955584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.410334:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971955584:12345-0@lo:400:kworker.0 Request processed in 34us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388155.410339:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787388155.410351:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388155.410357:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971954944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.410394:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971954944:12345-0@lo:400:kworker.0 Request processed in 28us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388155.410411:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388155.410435:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971954688 00000100:00100000:0.0:1787388155.410440:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971954688 00000100:00100000:0.0:1787388155.410466:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787388155.410471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874211971954688:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787388155.410476:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787388155.410502:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874211971954688:12345-0@lo:400:kworker.0 Request processed in 30us (3987us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787388155.410508:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787388155.410531:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955712 00000100:00100000:0.0:1787388155.410534:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955712 00000100:00100000:0.0:1787388155.410561:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787388155.410567:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971955712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388155.410589:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388155.410618:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971955712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388155.410624:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787388155.410928:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388155.410934:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388155.410936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388155.410952:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971955840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388155.410993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388155.411039:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955840 00000100:00100000:1.0:1787388155.411043:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955840 00000100:00100000:1.0:1787388155.411065:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787388155.411070:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1874211971955840:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787388155.411074:0:7930:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787388155.411104:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1874211971955840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 33us (111us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787388155.411110:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:02020000:1.0:1787388155.411140:0:3645:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1787388155.413967:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787388155.413975:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9273eeed1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787388155.413980:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787388155.414236:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971954944:0@lo:400:kworker.0 00010000:00080000:3.0:1787388155.414254:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9272c3e44e00 x1874211971955456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388155.414263:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971955456:0@lo:400:kworker.0 00000100:00080000:3.0:1787388155.414274:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787388155.414278:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9272c2426000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787388155.414281:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787388155.414285:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9272c2426000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388155.414289:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 232 00000100:00080000:3.0:1787388155.414297:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9272c2426000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388155.414331:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7ce00 x1874211971955968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388155.414356:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971955072:0@lo:400:kworker.0 00000100:00100000:3.0:1787388155.414372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971955584:0@lo:400:kworker.0 00000100:00080000:1.0:1787388155.423532:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787388155.423539:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9273cc6af000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787388155.423543:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787388155.423548:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9273cc6af000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388155.423552:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 213 00000100:00080000:1.0:1787388155.423562:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9273cc6af000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388155.423608:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa4ed80 x1874211971956096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388155.423708:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971955968:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787388155.423779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388155.423817:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971956096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787388155.423844:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388155.423876:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956096 00000100:00100000:1.0:1787388155.423883:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956096 00000100:00100000:1.0:1787388155.424013:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787388155.424023:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874211971956096:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1787388155.424044:0:7930:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388155.424094:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874211971956096:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 70us (248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388155.424101:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1787388155.424136:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273cc6af000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388155.424141:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388155.424144:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971956096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787388155.424173:0:13489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971955968 00000100:00100000:1.0:1787388155.424177:0:13489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971955968 00000100:00100000:1.0:1787388155.424212:0:13489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787388155.424216:0:13489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874211971955968:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1787388155.424227:0:13489:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388155.424330:0:13489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874211971955968:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 111us (551us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388155.424337:0:13489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1787388155.424360:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2426000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388155.424370:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388155.424374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971955968:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1787388155.452625:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9273eeed1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388155.452639:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 213 00000100:00080000:0.0:1787388155.452648:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9273eeed1000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388155.453154:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c446b480 x1874211971956224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388155.453204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971954816:0@lo:400:kworker.0 00000100:00100000:1.0:1787388155.453233:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874211971956224:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787388155.453245:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787388155.453251:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787388155.453254:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787388155.453258:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388155.453262:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 253 00000100:00080000:0.0:1787388155.453269:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9272c2fb8000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388155.453286:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c446aa00 x1874211971956352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388155.453298:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971955328:0@lo:400:kworker.0 00000100:00100000:1.0:1787388155.453312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787388155.453316:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787388155.453320:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9273cc6af000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:0.0:1787388155.453325:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971954688:0@lo:400:kworker.0 00010000:00080000:0.0:1787388155.453339:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9272c209c380 x1874211971955200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388155.453350:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971955200:0@lo:400:kworker.0 00000100:00100000:0.0:1787388155.453379:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971955712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388155.453429:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971956352:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787388155.454609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388155.459026:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956224 00000100:00100000:3.0:1787388155.459042:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956224 00000100:00100000:3.0:1787388155.459086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956352 00000100:00100000:3.0:1787388155.459090:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956352 00000100:00100000:3.0:1787388155.459113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787388155.459123:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971956224:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787388155.459157:0:6522:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787388155.459232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971956224:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 109us (5922us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787388155.459240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787388155.459257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787388155.459262:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971956352:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787388155.459272:0:6522:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787388155.459297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971956352:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (4692us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787388155.459303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787388155.464661:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388155.464710:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787388155.464717:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971956352:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787388155.464747:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eeed1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388155.464752:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787388155.464756:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874211971956224:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787388156.057066:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388157.065106:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388158.088130:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787388158.408940:0:15358:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787388158.435558:0:15358:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787388158.435613:0:15358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.435628:0:15358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.435635:0:15358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.435642:0:15358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.435727:0:15358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787388158.435733:0:15358:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787388158.435758:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388158.435865:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787388158.435872:0:15358:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787388158.435878:0:15358:0:(import.c:65:import_set_state_nolock()) ffff9273eeed1000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787388158.435883:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388158.435884:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787388158.435887:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787388158.437556:0:15358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.437588:0:15358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.437595:0:15358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.437603:0:15358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437697:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388158.437706:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437713:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fea00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:3.0:1787388158.437717:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437725:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388158.437733:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388158.437740:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787388158.437742:0:10340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787388158.437745:0:10340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787388158.437881:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437894:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388158.437927:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437933:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23fea00/0x5cb77467b1811af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811afa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437947:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388158.437951:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437956:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152a000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:3.0:1787388158.437959:0:10340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437965:0:10340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388158.437970:0:10340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388158.437975:0:10340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787388158.437977:0:10340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1787388158.437990:0:10340:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.437996:0:10340:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388158.438001:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388158.438016:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388158.438018:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388158.438020:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388158.438042:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971956608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388158.438109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388158.438164:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388158.438171:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971956480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388158.438193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388158.438230:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956608 00000100:00100000:3.0:1787388158.438238:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956608 00010000:00010000:1.0:1787388158.438239:0:15358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787388158.438244:0:15358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152a000/0x5cb77467b1811b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811b08 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438257:0:15358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438264:0:15358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438270:0:15358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438276:0:15358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438287:0:15358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388158.438292:0:15358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438308:0:15358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438315:0:15358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438321:0:15358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438348:0:15358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787388158.438354:0:15358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438360:0:15358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.438367:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388158.438367:0:15358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438553:0:15358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388158.438897:0:15358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787388158.438902:0:15358:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1787388158.438910:0:15358:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1787388158.438924:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.438931:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c152ae00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388158.438934:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.438940:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787388158.438944:0:15358:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 10000000:00010000:2.0:1787388158.438946:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1787388158.438948:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 10000000:01000000:2.0:1787388158.438951:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00000080:1.0:1787388158.438953:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:01000000:2.0:1787388158.438954:0:7471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787388158.438955:0:7471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:1.0:1787388158.438958:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787388158.438969:0:15358:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9272c2427000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1787388158.438974:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787388158.438975:0:15358:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9272c2422800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1787388158.438980:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1787388158.438981:0:15358:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9273fb15b380) has exports, disconnecting them 00000020:00080000:1.0:1787388158.438984:0:15358:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9272c2427000), last request at 1787388155 00000020:00000080:1.0:1787388158.438991:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18119a3 00010000:00010000:2.0:1787388158.438996:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787388158.439006:0:15358:0:(import.c:65:import_set_state_nolock()) ffff9272c2422000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787388158.439012:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c152ae00/0x5cb77467b18119db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18119e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439033:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388158.439036:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439082:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388158.439085:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439092:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388158.439098:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388158.439102:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787388158.439104:0:7471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787388158.439106:0:7471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787388158.439117:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439122:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388158.439127:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439133:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1497200/0x5cb77467b1811d69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b1811d70 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439149:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388158.439152:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439157:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1484400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388158.439160:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439165:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388158.439170:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388158.439175:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787388158.439177:0:7471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787388158.439178:0:7471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787388158.439209:0:7471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439220:0:7471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787388158.439260:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971956992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388158.439305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388158.439444:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439452:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1484400/0x5cb77467b18116c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5cb77467b18116cb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388158.439464:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388158.439466:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388158.439473:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388158.439481:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388158.439493:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971956864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388158.440091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388158.440097:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388158.440106:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971956736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388158.440133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388158.440169:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956480 00000100:00100000:3.0:1787388158.440175:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956480 00000100:00100000:3.0:1787388158.440195:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956992 00000100:00100000:3.0:1787388158.440197:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956992 00000100:00100000:3.0:1787388158.440210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787388158.440216:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274019eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874211971956608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787388158.440223:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388158 with bad export cookie 6680936560935900609 00000100:00100000:0.0:1787388158.441226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956736 00000100:00100000:0.0:1787388158.441256:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956736 00000100:00100000:0.0:1787388158.441291:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787388158.441297:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1874211971956480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787388158.441302:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388158 with bad export cookie 6680936560935900609 00000100:00100000:0.0:1787388158.441359:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1874211971956480:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (3164us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787388158.441366:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787388158.441384:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787388158.441388:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1874211971956992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787388158.441392:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388158 with bad export cookie 6680936560935900609 00000100:00100000:0.0:1787388158.441423:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1874211971956992:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (2116us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787388158.441429:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787388158.441440:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787388158.441456:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3644:x1874211971956736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787388158.441460:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388158 with bad export cookie 6680936560935900609 00000100:00100000:0.0:1787388158.441490:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3644:x1874211971956736:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (1357us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787388158.441496:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787388158.441528:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787388158.441533:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787388158.441537:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:1.0:1787388158.444030:0:15358:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9272c2427000): rc 0 00000020:00000080:1.0:1787388158.444037:0:15358:0:(genops.c:906:class_export_put()) final put ffff9272c2427000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787388158.444062:0:15358:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9272c2422800), last request at 1787388155 00000020:00000080:1.0:1787388158.444070:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18118ed 00000100:00080000:1.0:1787388158.444080:0:15358:0:(import.c:65:import_set_state_nolock()) ffff9272c2427800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787388158.444096:0:15358:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9272c2422800): rc 0 00000020:00000080:1.0:1787388158.444098:0:15358:0:(genops.c:906:class_export_put()) final put ffff9272c2422800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787388158.444105:0:15358:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffae0cc19fbae0 00000100:00080000:1.0:1787388158.444129:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388158.444139:0:15358:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9273ffa7ed80 x1874211971955840/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787388171 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388158.444151:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1787388158.450023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388158.450083:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971955840:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1787388158.450260:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2427000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:1.0:1787388158.451362:0:15358:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787388158.451370:0:15358:0:(import.c:65:import_set_state_nolock()) ffff9273cc6af000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:2.0:1787388158.451423:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2422800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787388158.451444:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2422000 for lustre-MDT0001 00000020:00000080:2.0:1787388158.451449:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2427800 for lustre-MDT0001 00010000:00010000:2.0:1787388158.451468:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388158.451483:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971956864 00000100:00100000:2.0:1787388158.451492:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971956864 00000100:00100000:2.0:1787388158.451533:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787388158.451540:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1874211971956864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787388158.451546:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388158 with bad export cookie 6680936560935900609 00000100:00080000:1.0:1787388158.451613:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787388158.451617:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1787388158.451623:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1874211971956864:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1609us total) trans 0 rc -107/-107 00000004:00080000:1.0:1787388158.451627:0:15358:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388158.451630:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787388158.451667:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787388158.451733:0:15358:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787388158.451744:0:15358:0:(import.c:65:import_set_state_nolock()) ffff9272c20d4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787388158.451757:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787388158.451759:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787388158.451780:0:15358:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787388158.453340:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274019eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874211971956608:12345-0@lo:103:ldlm_bl.0 Request processed in 13108us (15216us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787388158.453351:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787388158.453367:0:15358:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787388158.453395:0:15358:0:(import.c:65:import_set_state_nolock()) ffff9273fbf27000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787388158.453436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1874211971957120:0@lo:13:osp-pre-0-1.0 00000020:00080000:1.0:1787388158.453446:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9273fb15b380) has no exports 00000100:00080000:3.0:1787388158.453455:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787388158.459944:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787388158.471772:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.152@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787388158.471778:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787388158.471789:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c209dc00 x1874211971954560/t0(0) o400->MGC192.168.204.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787388171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388158.471975:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9273ffa7d880 x1874211971956608/t0(0) o103->MGC192.168.204.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388174 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388158.471983:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9273ffa7d180 x1874211971956480/t0(0) o103->MGC192.168.204.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388158.471991:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3cbbb80 x1874211971956992/t0(0) o103->MGC192.168.204.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388158.471999:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3cbad80 x1874211971956864/t0(0) o103->MGC192.168.204.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388158.472007:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3cbb100 x1874211971956736/t0(0) o103->MGC192.168.204.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787388158.472016:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787388158.472019:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787388158.472021:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787388158.472131:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9273d0f05000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787388158.472155:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3645:1874211971956864:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787388158.472420:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9273d0f05000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787388158.472441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971956608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388158.472452:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971954560:0@lo:400:kworker.0 00000100:00100000:3.0:1787388158.472494:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3647:1874211971956480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388158.472517:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388158.472587:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9273d0f05000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787388158.472598:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3644:1874211971956736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388158.472951:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971957248:0@lo:9:umount.0 00000100:00100000:1.0:1787388158.473017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388158.473066:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971957376:0@lo:9:umount.0 00000100:00100000:1.0:1787388158.473092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388158.473155:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971957248 00000100:00100000:1.0:1787388158.473163:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971957248 00000100:00100000:1.0:1787388158.473215:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971957376 00000100:00100000:1.0:1787388158.473218:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971957376 00000100:00100000:1.0:1787388158.473240:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787388158.473249:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874211971957248:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787388158.473349:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18118fb 00000100:00080000:1.0:1787388158.473358:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9272c20d1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388158.473392:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787388158.473533:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3643:x1874211971957248:12345-0@lo:9:umount.0 Request processed in 285us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388158.473541:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787388158.473557:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787388158.473564:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874211971957376:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787388158.473576:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a0c 00000100:00080000:1.0:1787388158.473591:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9272c2f66800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388158.473615:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787388158.473726:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3643:x1874211971957376:12345-0@lo:9:umount.0 Request processed in 162us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388158.473733:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787388158.473751:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388158.473755:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388158.474011:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c20d4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787388158.474059:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:2.0:1787388158.474175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787388158.474383:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388158.474390:0:3646:0:(import.c:510:import_select_connection()) MGC192.168.204.152@tcp: connect to NID 0@lo last attempt 195 00000100:00080000:0.0:1787388158.474398:0:3646:0:(import.c:624:import_select_connection()) MGC192.168.204.152@tcp: import ffff9273d0f05000 using connection 192.168.204.152@tcp/0@lo 00010000:00010000:0.0:1787388158.474413:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388158.474438:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2711180 x1874211971957504/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388158.474461:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3646:1874211971956992:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1787388158.474575:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388158.474580:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971957248:0@lo:9:umount.0 00000100:00080000:1.0:1787388158.474596:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273fbf27000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787388158.474646:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787388158.475030:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388158.475035:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971957376:0@lo:9:umount.0 00000100:00100000:1.0:1787388158.475055:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971957504:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787388158.475086:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211971957504 offset 0 length 520: 4 00000020:00080000:1.0:1787388158.480385:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9273fb15b380) has no exports 00000020:01000000:0.0:1787388158.545012:0:15358:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9272c27bcea0 - data ffff9273c5f12e58/ffff9273fbd85400 00000020:01000000:0.0:1787388158.545166:0:15358:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9273fbe7a7e0 - data ffff9273c5dc36c0/ffff9273fbeb2400 00000001:00000004:0.0:1787388158.559034:0:15358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787388158.612974:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388158.612982:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787388158.612989:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787388158.616189:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787388158.616198:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787388158.616215:0:15358:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388158.616217:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787388158.616554:0:8454:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787388158.616559:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1787388158.616570:0:8454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787388158.617136:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787388158.617139:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787388158.617160:0:15358:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388158.617162:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787388158.621069:0:9914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787388158.621076:0:9914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787388158.621103:0:9914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787388158.623110:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18116e7 00000020:00000080:1.0:1787388158.623121:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273fb14a800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388158.623792:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb14a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787388158.626844:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18116fc 00000020:00000080:1.0:1787388158.626871:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273ea89d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787388158.626887:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787388158.626892:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388158.626901:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787388158.626904:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9274019599c0) has no exports 00000020:00000080:3.0:1787388158.627060:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273ea89d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1787388158.627070:0:15358:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787388158.627078:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811a05 00000020:00000080:1.0:1787388158.627082:0:15358:0:(genops.c:906:class_export_put()) final put ffff9272c2f65800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787388158.627095:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787388158.627099:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388158.627107:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787388158.627109:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9272c24199c0) has no exports 00000020:00000080:1.0:1787388158.627116:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18119fe 00000020:00000080:1.0:1787388158.627120:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273fbf23800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388158.627240:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2f65800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787388158.627246:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbf23800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787388158.627469:0:15358:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787388158.627474:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787388158.627478:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787388158.627484:0:15358:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388158.627487:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787388158.627534:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388158.627542:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787388158.627558:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181185a 00000020:00000080:1.0:1787388158.627563:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273f5dc1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787388158.627567:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787388158.627570:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388158.627574:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787388158.627577:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9273ef9f0000) has no exports 00000020:00000080:1.0:1787388158.627580:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811845 00000020:00000080:1.0:1787388158.627583:0:15358:0:(genops.c:906:class_export_put()) final put ffff9272c20d0000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388158.627656:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273fbf27000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787388158.627663:0:36:0:(genops.c:906:class_export_put()) final put ffff9272c2370800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388158.627665:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2370800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787388158.627670:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388158.627768:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f5dc1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787388158.627772:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c20d0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787388158.627929:0:15358:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787388158.627932:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787388158.627934:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787388158.627944:0:15358:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388158.627946:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787388158.627981:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388158.627987:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787388158.627998:0:15358:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787388158.628002:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181171f 00000020:00000080:1.0:1787388158.628007:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273fb149000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787388158.628010:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787388158.628014:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388158.628017:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787388158.628019:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9273ef9f3380) has no exports 00000020:00000080:1.0:1787388158.628024:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811718 00000020:00000080:1.0:1787388158.628026:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273c9f12800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388158.628099:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c20d4000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787388158.628105:0:36:0:(genops.c:906:class_export_put()) final put ffff9272c20d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388158.628107:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c20d6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787388158.628111:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388158.628141:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb149000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787388158.628146:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9f12800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787388158.707207:0:15358:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787388158.707217:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388158.707244:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787388158.707256:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787388158.707337:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388158.707352:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787388158.707370:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273cc6af000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787388158.707385:0:36:0:(genops.c:906:class_export_put()) final put ffff9273d0370800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787388158.707396:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273d0370800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787388158.707406:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:01000000:2.0:1787388158.707409:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388158.707412:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388158.707418:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273fb14b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388158.707421:0:15358:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb14b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787388158.707430:0:15358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388158.708596:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811703 00000020:00000080:3.0:1787388158.708607:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273ea89a000/lustre-MDD0001_UUID 00000020:01000000:3.0:1787388158.708627:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787388158.708632:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388158.708639:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787388158.708643:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9273fb158000) has no exports 00000020:00000080:3.0:1787388158.708665:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388158.708670:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787388158.708674:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181170a 00000020:00000080:3.0:1787388158.708696:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273ea89f000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787388158.708698:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273ea89a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787388158.708705:0:36:0:(genops.c:906:class_export_put()) final put ffff9273fb149800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787388158.708708:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb149800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:3.0:1787388158.708712:0:15358:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273eedc0000 from lustre-MDT0001, refs=2 00000020:01000000:2.0:1787388158.708715:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:3.0:1787388158.708718:0:15358:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273eedc0000 2 00000020:01000004:3.0:1787388158.708723:0:15358:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9273eedc0000 from lustre-MDT0001 00000020:00000080:3.0:1787388158.708750:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388158.708755:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787388158.708757:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273fb148800/lustre-MDT0001_UUID 00000020:00000080:3.0:1787388158.708760:0:15358:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fb148800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787388158.708772:0:15358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:2.0:1787388158.708943:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9273ea89f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:3.0:1787388158.709977:0:15358:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787388158.709984:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787388158.709988:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388158.709994:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787388158.710001:0:15358:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9273eeed7800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388158.710936:0:15358:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9273d0f419c0) has exports, disconnecting them 00000020:00080000:3.0:1787388158.710944:0:15358:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9273eeed7800), last request at 1787387924 00000020:00000080:3.0:1787388158.710948:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181175e 00000020:00080000:3.0:1787388158.710970:0:15358:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273eeed7800): rc 0 00000020:00000080:3.0:1787388158.710975:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273eeed7800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787388158.711197:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eeed7800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787388158.711764:0:15358:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787388158.711770:0:15358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388158.711774:0:15358:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787388158.711779:0:15358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388158.711801:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273eeed1000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787388158.712443:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388158.712452:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787388158.712457:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273eeed6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787388158.712461:0:15358:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eeed6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787388158.712466:0:15358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787388158.713297:0:15358:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273eedc0000 1 00000020:00000080:2.0:1787388158.713306:0:15358:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181169a 00000020:00000080:2.0:1787388158.713312:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273eecb4800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787388158.713336:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787388158.713347:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eecb4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787388158.713360:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388158.713367:0:15358:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787388158.713370:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9273eedf8000) has no exports 00000020:00000080:1.0:1787388158.820366:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388158.820382:0:15358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787388158.820388:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273eedc2000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787388158.820393:0:15358:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eedc2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787388158.820405:0:15358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787388158.820525:0:15358:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9273eedc6000 00000020:01000000:1.0:1787388158.820546:0:15358:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787388158.820550:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388158.820553:0:15358:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787388158.820557:0:15358:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9273c4a48000) has no exports 00000100:00100000:3.0:1787388158.820816:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9273dfbcd200:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1787388158.820948:0:13489:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9272c36dd800:13489] 4 exiting: rc = 0 00000100:00100000:1.0:1787388158.821098:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9273dfbcd000:6521] 1 exiting: rc = 0 00000100:00100000:2.0:1787388158.821296:0:9533:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9272c2faf600:9533] 3 exiting: rc = 0 00000100:00100000:0.0:1787388158.821888:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9273df99da00:6522] 2 exiting: rc = 0 00000100:00100000:1.0:1787388158.822010:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822019:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822027:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822032:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822040:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822045:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822051:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822057:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822062:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822170:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822175:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822181:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822186:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822191:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822196:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822202:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822207:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822213:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822229:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822235:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822241:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822247:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822260:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822266:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822277:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822282:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822287:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822292:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822297:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822304:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822310:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822315:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822398:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822405:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822411:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822419:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822425:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822430:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822436:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822442:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822447:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822454:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822462:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822468:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822482:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822488:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822493:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822498:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822504:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822510:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822517:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822522:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822527:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822534:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822539:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822544:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822549:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822555:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822560:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822565:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822570:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822575:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822579:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.822594:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.826670:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff927401b12200:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1787388158.826841:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9273c910be00:6524] 1 exiting: rc = 0 00000100:00100000:0.0:1787388158.826982:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.826990:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.826997:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827003:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827010:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827016:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827022:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827028:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827033:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827039:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827045:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827051:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827058:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827133:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827142:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827147:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827151:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827156:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827162:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827166:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827171:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827177:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827197:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827202:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827207:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827212:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827217:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827222:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827227:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827233:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827239:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827244:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827249:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827255:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827260:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827265:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827271:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827276:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827281:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827285:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827290:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827294:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827299:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827304:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827309:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827314:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827330:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827336:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827341:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827346:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827351:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827356:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827360:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827365:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827370:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827375:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827381:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827394:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827400:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827404:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827409:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827414:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827419:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.827424:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.828265:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9273ca2f8400:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1787388158.828362:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9273dfafd000:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1787388158.828663:0:7930:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9273eeea5e00:7930] 2 exiting: rc = 0 00000100:00100000:0.0:1787388158.829545:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829556:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829563:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829570:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829596:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829603:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829610:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829616:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829622:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829628:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829634:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829640:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829646:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829653:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829658:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829665:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829711:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829718:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829723:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829729:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829734:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829738:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829743:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829749:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829755:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829760:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829778:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829784:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829802:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829809:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829814:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829820:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829826:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829832:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829837:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829843:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829848:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829853:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829859:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829867:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829889:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829896:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829902:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829908:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829914:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829919:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829925:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829930:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829936:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829942:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829947:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829953:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829972:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829978:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829985:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829990:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.829996:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830002:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830008:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830013:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830019:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830030:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830035:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.830041:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.839895:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9273d3fe8200:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1787388158.840029:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9273c4f27c00:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1787388158.840153:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840162:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840167:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840172:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840177:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840182:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840187:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840192:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840197:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840202:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840207:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840212:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840217:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840223:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840228:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840233:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840238:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840243:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840248:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840253:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840258:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840263:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840269:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840273:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840278:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840284:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840289:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840294:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840299:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840305:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840310:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.840315:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846940:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846951:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846966:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846972:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846978:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846984:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846990:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.846995:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847001:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847007:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847012:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847018:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847022:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847538:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847548:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847553:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847567:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847575:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847581:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847588:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847597:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847609:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847617:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847626:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847635:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847645:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847654:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847659:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.847670:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.848223:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.848230:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.848235:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.849823:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9273d0fb7a00:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1787388158.849976:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9273c4f27800:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1787388158.850073:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850080:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850085:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850102:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850107:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850113:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850119:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850124:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850129:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850134:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850140:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850145:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850150:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850155:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850160:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850166:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850172:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850177:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850182:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850187:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850191:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850196:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850202:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850207:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850212:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850218:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850223:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850228:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850233:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850238:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850243:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850248:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850254:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850258:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850263:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850268:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850273:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850278:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850290:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850294:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850299:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850304:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850309:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850314:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850329:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850335:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850340:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850345:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850350:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850354:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850359:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850364:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850369:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850374:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850379:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850384:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850389:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850395:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850400:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850405:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850410:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850416:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850421:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.850426:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388158.851027:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9273d0fb6c00:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1787388158.851137:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9273d0fb7400:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1787388158.851219:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851226:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851232:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851238:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851244:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851249:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851255:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851260:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851265:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851282:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851287:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851293:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851298:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851303:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851309:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851314:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851330:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851337:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851343:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851348:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851353:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851358:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851364:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851370:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851374:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851379:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851384:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851389:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851394:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851400:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851405:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851410:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851415:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851420:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851426:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851431:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851437:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851442:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851448:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851453:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851458:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851463:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851468:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851473:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851485:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851490:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851496:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851503:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851507:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851513:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851518:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851524:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851529:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851534:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851539:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851545:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851550:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851555:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851626:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851631:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851636:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851641:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851646:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388158.851651:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.856417:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9273d0fac400:6533] 0 exiting: rc = 1 00000100:00100000:0.0:1787388158.856847:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9273d0fb7800:6535] 2 exiting: rc = 0 00000100:00100000:2.0:1787388158.857280:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9273d0fb7c00:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1787388158.858066:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858077:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858082:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858089:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858094:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858100:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858106:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858111:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858116:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858137:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858142:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858147:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858151:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858156:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858161:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858167:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858172:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858178:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858183:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858189:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858194:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858200:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858205:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858212:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858218:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858240:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858246:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858298:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858307:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858313:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858329:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858335:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858341:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858347:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858352:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858357:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858363:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858368:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858374:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858380:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858386:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858391:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858397:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858403:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858417:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858423:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858429:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858435:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858441:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858461:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858468:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858476:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858482:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858488:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858494:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858500:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858505:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858512:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858518:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858524:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858530:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858535:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858541:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388158.858555:0:15358:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787388158.865349:0:15358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388158.865365:0:15358:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787388158.865371:0:15358:0:(genops.c:906:class_export_put()) final put ffff9273c9f10800/MDS_uuid 00000020:00000080:1.0:1787388158.865376:0:15358:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9f10800/MDS_uuid for MDS 00000020:01000000:1.0:1787388158.865382:0:15358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787388158.865536:0:15358:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787388159.120257:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388160.135941:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388160.522831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388160.522843:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388160.522847:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388160.522851:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787388160.522854:0:36:0:(import.c:65:import_set_state_nolock()) ffff9272c2426000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388160.522863:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1787388160.522888:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787388160.522895:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9272c2426000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388160.522933:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3ca9880 x1874211971957632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388160.523008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388160.523012:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787388160.523014:0:36:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388160.523018:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1787388160.523021:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787388160.523024:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9272c2fb8000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388160.523045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3cab800 x1874211971957888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388160.523408:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971957632:0@lo:38:kworker.0 00000400:00000100:2.0:1787388160.523462:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971957632 offset 0 length 520: 4 00000100:00100000:2.0:1787388160.523532:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971957888:0@lo:38:kworker.0 00000400:00000100:2.0:1787388160.523550:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971957888 offset 0 length 520: 4 00000100:00100000:2.0:1787388160.523588:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971958016:0@lo:400:kworker.0 00000400:00000100:2.0:1787388160.523622:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958016 offset 0 length 224: 4 00000100:00100000:2.0:1787388160.523637:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388160.523643:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971957760:0@lo:400:kworker.0 00000400:00000100:2.0:1787388160.523658:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971957760 offset 0 length 224: 4 00010000:00010000:3.0:1787388161.160018:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388162.185619:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787388162.847000:0:15559:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787388162.857757:0:15559:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787388162.857808:0:15559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388162.857822:0:15559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388162.857830:0:15559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388162.857842:0:15559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388162.857860:0:15559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787388162.857865:0:15559:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787388162.857959:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388162.857965:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.857973:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b4a00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388162.857977:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.857985:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388162.857993:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388162.858012:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388162.858015:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787388162.858017:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787388162.858031:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:1.0:1787388162.858034:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.858040:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b4a00/0x5cb77467b1811ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.858051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388162.858053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388162.858055:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388162.858089:0:15559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388162.858100:0:15559:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3ca9880 x1874211971957632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388162.858122:0:15559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787388162.858128:0:15559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787388162.858134:0:15559:0:(import.c:65:import_set_state_nolock()) ffff9272c2426000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787388162.858143:0:15559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388162.858148:0:15559:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3ca9880 x1874211971957632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388175 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388162.858155:0:15559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787388162.858158:0:15559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1787388162.858214:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971957632:0@lo:38:kworker.0 00000100:00080000:3.0:1787388162.859261:0:15559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388162.859272:0:15559:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3ca8a80 x1874211971957760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388176 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388162.859340:0:15559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787388162.859345:0:15559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787388162.859366:0:15559:0:(import.c:65:import_set_state_nolock()) ffff9273f5dc7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787388162.859826:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874211971958144:0@lo:39:umount.0 00000400:00000100:0.0:1787388162.859879:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958144 offset 0 length 224: 4 00000100:00100000:1.0:1787388162.860057:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971957760:0@lo:400:kworker.0 00010000:00010000:0.0:1787388163.209617:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787388163.528703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787388163.528714:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388163.528717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787388163.528720:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388163.529486:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388163.529515:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971958272:0@lo:400:kworker.0 00000400:00000100:3.0:1787388163.529574:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958272 offset 0 length 224: 4 00000001:00100000:0.0:1787388164.111867:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787388164.111893:0:9516:0:(genops.c:906:class_export_put()) final put ffff9272c2f61000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787388164.114138:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2f61000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787388164.114202:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2f66800 for lustre-OST0001 00000001:00100000:3.0:1787388164.114815:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388164.114822:0:8429:0:(genops.c:906:class_export_put()) final put ffff9272c20d3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787388164.114897:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c20d3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787388164.114943:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c20d1000 for lustre-OST0000 00010000:00010000:2.0:1787388164.232360:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388165.256872:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787388165.576087:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787388165.576098:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388165.576101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787388165.576104:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388165.576251:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971958400:0@lo:400:kworker.0 00000400:00000100:3.0:1787388165.576309:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958400 offset 0 length 224: 4 00010000:00010000:1.0:1787388166.280072:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388167.304221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388168.007904:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388158/real 1787388158] req@ffff9272c2711180 x1874211971957504/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787388168 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388168.007940:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c2711180 x1874211971957504/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787388168 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388168.007963:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388168.007990:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787388168.007995:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971957504:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1787388168.008158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388168.008164:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787388168.008167:0:8:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388168.008172:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.152@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:1.0:1787388168.008177:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787388168.008184:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.152@tcp: import ffff9273d0f05000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388168.008216:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3ca9880 x1874211971958528/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388168.008255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388168.008259:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388168.008349:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388168.008362:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971958656:0@lo:400:kworker.0 00000400:00000100:3.0:1787388168.008415:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958656 offset 0 length 224: 4 00000100:00100000:0.0:1787388168.008569:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971958528:0@lo:250:kworker.0 00000400:00000100:0.0:1787388168.008594:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211971958528 offset 0 length 520: 4 00010000:00010000:0.0:1787388168.331025:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388169.352082:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388170.376407:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388171.400696:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388172.104131:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388162/real 1787388162] req@ffff9273ffa7d180 x1874211971958144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388172.104176:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7d180 x1874211971958144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787388172.104190:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273f5dc7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787388172.104210:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874211971958144:0@lo:39:umount.0 00000100:00080000:3.0:1787388172.104278:0:15559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388172.104283:0:15559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787388172.104288:0:15559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787388172.105247:0:15559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105265:0:15559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105273:0:15559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105280:0:15559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105308:0:15559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388172.105316:0:15559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105324:0:15559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105330:0:15559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105336:0:15559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388172.105357:0:15559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787388172.105362:0:15559:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787388172.105389:0:15559:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787388172.105394:0:15559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787388172.105399:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388172.105404:0:15559:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787388172.105416:0:15559:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff9273d0f43380) has no exports 00000020:00080000:3.0:1787388172.105438:0:15559:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff9273d0f43380) has no exports 00010000:00010000:0.0:1787388172.105565:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388172.105575:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105585:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388172.105589:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105598:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388172.105617:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388172.105624:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388172.105627:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787388172.105630:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787388172.105645:0:10341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:0.0:1787388172.105649:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105656:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ff000/0x5cb77467b1811ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811aec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105671:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388172.105674:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105747:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388172.105751:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105758:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388172.105764:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388172.105770:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787388172.105772:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787388172.105780:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787388172.105789:0:10341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:0.0:1787388172.105793:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105800:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5400/0x5cb77467b1811d5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811d62 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388172.105810:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388172.105812:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388172.105815:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388172.107569:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787388172.112225:0:15559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9272c27bca20 - data ffff9273c5eec510/ffff9273fbd7a800 00000020:01000000:3.0:1787388172.112396:0:15559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9272c10c8cc0 - data ffff9273c5eb4d80/ffff9272c25a8c00 00100000:10000000:3.0:1787388172.126507:0:15559:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787388172.145506:0:15559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811853 00000020:00000080:2.0:1787388172.145520:0:15559:0:(genops.c:906:class_export_put()) final put ffff9273eee81000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787388172.145533:0:15559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273eef18800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787388172.145537:0:15559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273eef18800 2 00000020:01000004:2.0:1787388172.145540:0:15559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9273eef18800 from lustre-OST0000 00000020:00000080:2.0:1787388172.145564:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388172.145575:0:15559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787388172.145578:0:15559:0:(genops.c:906:class_export_put()) final put ffff9273eecb2000/lustre-OST0000_UUID 00000020:00000080:2.0:1787388172.145581:0:15559:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eecb2000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787388172.145588:0:15559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787388172.145664:0:15559:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787388172.145669:0:15559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787388172.145673:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388172.145695:0:15559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787388172.145703:0:15559:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9272c2420800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388172.145709:0:15559:0:(genops.c:1574:class_disconnect_exports()) OBD device 21 (ffff9272c241cd40) has exports, disconnecting them 00000020:00080000:2.0:1787388172.145714:0:15559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9272c2420800), last request at 1787387943 00000020:00000080:2.0:1787388172.145718:0:15559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18118d1 00000020:00080000:2.0:1787388172.145727:0:15559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9272c2420800): rc 0 00000020:00000080:2.0:1787388172.145733:0:15559:0:(genops.c:906:class_export_put()) final put ffff9272c2420800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787388172.146202:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eee81000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787388172.146219:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2420800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787388172.157725:0:15559:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787388172.157735:0:15559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787388172.157740:0:15559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787388172.157750:0:15559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388172.157898:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388172.157906:0:15559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787388172.157914:0:15559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787388172.157930:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388172.157935:0:15559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787388172.157941:0:15559:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9273f5dc3800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787388172.157947:0:15559:0:(genops.c:1574:class_disconnect_exports()) OBD device 22 (ffff9273fb1599c0) has exports, disconnecting them 00000020:00080000:0.0:1787388172.157952:0:15559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9273f5dc3800), last request at 1787387943 00000020:00000080:0.0:1787388172.157956:0:15559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18118e6 00000020:00080000:0.0:1787388172.157974:0:15559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9273f5dc3800): rc 0 00000020:00000080:0.0:1787388172.157980:0:15559:0:(genops.c:906:class_export_put()) final put ffff9273f5dc3800/lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787388172.184933:0:15559:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787388172.184942:0:15559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787388172.184947:0:15559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787388172.184953:0:15559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388172.185152:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388172.185162:0:15559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787388172.185172:0:15559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273eef18800 1 00000020:00000080:2.0:1787388172.185181:0:15559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18117f1 00000020:00000080:2.0:1787388172.185193:0:15559:0:(genops.c:906:class_export_put()) final put ffff9273fbc55000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787388172.185200:0:15559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787388172.185205:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388172.185210:0:15559:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787388172.185214:0:15559:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9273fb15cd40) has no exports 00000020:00000080:1.0:1787388172.256717:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2426000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787388172.256734:0:8:0:(genops.c:906:class_export_put()) final put ffff9272c2373000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787388172.256738:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2373000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787388172.256749:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787388172.257073:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273f5dc3800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787388172.257333:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273f5dc7800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787388172.257357:0:8:0:(genops.c:906:class_export_put()) final put ffff9273ea89b800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787388172.257360:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273ea89b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787388172.257363:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787388172.257413:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbc55000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787388172.301492:0:15559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388172.301517:0:15559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787388172.301523:0:15559:0:(genops.c:906:class_export_put()) final put ffff9273eef1f000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787388172.301528:0:15559:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eef1f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787388172.301540:0:15559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787388172.301657:0:15559:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9273eef1f800 00000020:02000400:1.0:1787388172.301791:0:15559:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787388172.433221:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388173.320273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388173.320286:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388173.320289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388173.320294:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787388173.320425:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388173.320449:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971958784:0@lo:400:kworker.0 00000400:00000100:2.0:1787388173.320516:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958784 offset 0 length 224: 4 00010000:00010000:0.0:1787388173.449562:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388174.472883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388175.178796:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388160/real 1787388160] req@ffff9272c3cab800 x1874211971957888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787388175 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388175.178852:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c3cab800 x1874211971957888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787388175 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388175.178867:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388175.178896:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787388175.178901:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971957888:0@lo:38:kworker.0 00000100:00080000:1.0:1787388175.180010:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388175.180017:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388175.180020:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388175.180023:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787388175.180026:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388175.180032:0:14986:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1787388175.180038:0:14986:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787388175.180045:0:14986:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9272c2fb8000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388175.180080:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3caa300 x1874211971958912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388175.180145:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971958912:0@lo:38:kworker.0 00000100:00100000:1.0:1787388175.180159:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971959040:0@lo:400:kworker.0 00000400:00000100:1.0:1787388175.180327:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971959040 offset 0 length 224: 4 00000400:00000100:0.0:1787388175.180805:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971958912 offset 0 length 520: 4 00010000:00010000:1.0:1787388175.498324:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787388175.679491:0:15760:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787388175.697190:0:15760:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787388175.697281:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388175.697314:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388175.697321:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388175.697328:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388175.697393:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787388175.697399:0:15760:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787388175.697426:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388175.697441:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3caa300 x1874211971958912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388175.697466:0:15760:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787388175.697472:0:15760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787388175.697479:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9272c2fb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787388175.697483:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388175.697486:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3caa300 x1874211971958912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388195 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388175.697493:0:15760:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787388175.697495:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:0.0:1787388175.698365:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971958912:0@lo:38:kworker.0 00000100:00080000:3.0:1787388175.702429:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388175.702451:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3caad80 x1874211971958016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388176 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388175.702483:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c2712d80 x1874211971958272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388179 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388175.702497:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c2711880 x1874211971958400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388175.702506:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3ca9500 x1874211971958656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388184 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388175.702514:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9273ffa7d880 x1874211971958784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388175.702524:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9272c3ca8700 x1874211971959040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388175.702543:0:15760:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787388175.702549:0:15760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787388175.702575:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9272c2fbc800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787388175.702872:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971958400:0@lo:400:kworker.0 00000100:00100000:0.0:1787388175.702879:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971958272:0@lo:400:kworker.0 00000100:00100000:0.0:1787388175.702914:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971958784:0@lo:400:kworker.0 00000100:00100000:0.0:1787388175.702940:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874211971959168:0@lo:39:umount.0 00000400:00000100:0.0:1787388175.703009:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211971959168 offset 0 length 224: 4 00000100:00100000:2.0:1787388175.703084:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971958656:0@lo:400:kworker.0 00000100:00100000:2.0:1787388175.703092:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211971958016:0@lo:400:kworker.0 00010000:00010000:1.0:1787388175.703337:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388175.703347:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388175.703357:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273e76b5800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388175.703361:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388175.703388:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388175.703395:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388175.703401:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388175.703403:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787388175.703407:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787388175.703422:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:1.0:1787388175.703425:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388175.703431:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5800/0x5cb77467b1811abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811ac2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388175.703471:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874211971959040:0@lo:400:kworker.0 00010000:00010000:1.0:1787388175.703485:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388175.703487:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388175.703489:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388176.520717:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388177.543911:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388178.568053:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388179.592049:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388180.488485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388180.488496:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787388180.616562:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388181.640200:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388182.663865:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388183.688576:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388183.879834:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388168/real 1787388168] req@ffff9272c3ca9880 x1874211971958528/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787388183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388183.879868:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c3ca9880 x1874211971958528/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787388183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388183.879899:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388183.879994:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787388183.879999:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971958528:0@lo:250:kworker.0 00000100:00080000:3.0:1787388183.883540:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388183.883570:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787388183.883574:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388183.883582:0:14986:0:(import.c:510:import_select_connection()) MGC192.168.204.152@tcp: connect to NID 0@lo last attempt 456 00000100:00080000:3.0:1787388183.883588:0:14986:0:(import.c:589:import_select_connection()) MGC192.168.204.152@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787388183.883596:0:14986:0:(import.c:624:import_select_connection()) MGC192.168.204.152@tcp: import ffff9273d0f05000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388183.883631:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7c000 x1874211971959296/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388183.883723:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971959296:0@lo:250:kworker.0 00000400:00000100:0.0:1787388183.883775:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211971959296 offset 0 length 520: 4 00010000:00010000:0.0:1787388184.711953:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388185.736497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388185.927847:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388175/real 1787388175] req@ffff9273ffa7d180 x1874211971959168/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388185.927881:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7d180 x1874211971959168/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388185.927904:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2fbc800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787388185.927929:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874211971959168:0@lo:39:umount.0 00000100:00080000:3.0:1787388185.928045:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388185.928050:0:15760:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787388185.928056:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787388185.928971:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.928988:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.928996:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.929002:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.929031:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388185.929039:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.929046:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.929074:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.929080:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388185.929101:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787388185.929107:0:15760:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787388185.929131:0:15760:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787388185.929135:0:15760:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787388185.929139:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388185.929145:0:15760:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787388185.929149:0:15760:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9272c2cd8000) has no exports 00000020:00080000:3.0:1787388185.929170:0:15760:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9272c2cd8000) has no exports 00010000:00010000:0.0:1787388185.931536:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388185.931549:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931562:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffa00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388185.931566:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931575:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388185.931582:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388185.931589:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388185.931609:0:7471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787388185.931612:0:7471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787388185.931631:0:7471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:0.0:1787388185.931635:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931642:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1811ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811ad0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931656:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388185.931660:0:7471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931665:0:7471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:0.0:1787388185.931668:0:7471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931675:0:7471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388185.931721:0:7471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388185.931727:0:7471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787388185.931729:0:7471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787388185.931731:0:7471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787388185.931735:0:7471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:0.0:1787388185.931738:0:7471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931745:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23fe800/0x5cb77467b1811d4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811d54 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.931767:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388185.931769:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388185.931771:0:7471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388185.931884:0:10340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787388185.935815:0:15760:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff927401afc8a0 - data ffff9273c5eedaf8/ffff9272c3777400 00000020:01000000:3.0:1787388185.935954:0:15760:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9272c27bc600 - data ffff9273c5e3abd0/ffff9272c34c2000 00100000:10000000:2.0:1787388185.962811:0:15760:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787388185.972900:0:15760:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181195d 00000020:00000080:0.0:1787388185.972913:0:15760:0:(genops.c:906:class_export_put()) final put ffff9273eecb5000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787388185.972937:0:15760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927401ba8000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787388185.972941:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927401ba8000 2 00000020:01000004:0.0:1787388185.972944:0:15760:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff927401ba8000 from lustre-OST0001 00000020:00000080:0.0:1787388185.972986:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388185.973001:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787388185.973004:0:15760:0:(genops.c:906:class_export_put()) final put ffff927401bad000/lustre-OST0001_UUID 00000020:00000080:0.0:1787388185.973008:0:15760:0:(genops.c:865:class_export_destroy()) destroying export ffff927401bad000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787388185.973017:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787388185.973141:0:15760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 29e41aeb-8af0-4a54-a54e-7e42c8606c3d->MGS 00000020:00000080:3.0:1787388185.973157:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273eecb5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1787388185.973158:0:15760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c1484a00/0x5cb77467b18116b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388185.973171:0:15760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c1484a00/0x5cb77467b18116b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388185.973180:0:15760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787388185.973183:0:15760:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787388185.973187:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787388185.973211:0:15760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:0.0:1787388185.973215:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c1484a00/0x5cb77467b18116b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b18116bd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388185.973246:0:15760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388185.975732:0:15760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388185.975739:0:15760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388185.975742:0:15760:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787388185.975745:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787388185.975767:0:15760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9273d0f05000 00010000:00010000:0.0:1787388185.975771:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273e76b5600/0x5cb77467b1811b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5cb77467b1811b32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787388185.975810:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9273d0f05000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787388185.975815:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787388185.975817:0:15760:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787388185.975819:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787388185.975823:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787388185.975835:0:15760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9273ffa7c000 x1874211971959296/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787388203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787388185.975924:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787388185.975927:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1787388185.976165:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:29e41aeb-8af0-4a54-a54e-7e42c8606c3d:3643:1874211971959296:0@lo:250:kworker.0 10000000:01000000:3.0:1787388185.976736:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787388185.976749:0:15760:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b18115b3 00000020:00000080:3.0:1787388185.976758:0:15760:0:(genops.c:906:class_export_put()) final put ffff9273c9f15800/29e41aeb-8af0-4a54-a54e-7e42c8606c3d 00000020:01000000:3.0:1787388185.976776:0:15760:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.152@tcp (flags='') 00000020:00000080:3.0:1787388185.976795:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388185.976803:0:15760:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787388185.976807:0:15760:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9273d0f44d40) has no exports 00000020:00000080:1.0:1787388185.976867:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273c9f15800/29e41aeb-8af0-4a54-a54e-7e42c8606c3d for MGC192.168.204.152@tcp 10000000:01000000:0.0:1787388185.984206:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787388185.986600:0:15760:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.152@tcp: client import never connected 00000100:00080000:3.0:1787388185.986610:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787388185.986615:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787388185.986620:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787388185.986623:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787388185.986718:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388185.989337:0:15760:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.152@tcp (uuid 29e41aeb-8af0-4a54-a54e-7e42c8606c3d) 00000020:01000000:3.0:1787388185.989354:0:15760:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787388185.989363:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388185.989370:0:15760:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787388185.989382:0:15760:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9272c2fbe000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388185.989398:0:15760:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9273ef9f4d40) has exports, disconnecting them 00000020:00080000:3.0:1787388185.989404:0:15760:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9272c2fbe000), last request at 1787387964 00000020:00000080:3.0:1787388185.989409:0:15760:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b1811987 00000020:00080000:3.0:1787388185.989430:0:15760:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9272c2fbe000): rc 0 00000020:00000080:3.0:1787388185.989435:0:15760:0:(genops.c:906:class_export_put()) final put ffff9272c2fbe000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787388185.992329:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9273d0f05000 for MGC192.168.204.152@tcp 00000020:00000080:1.0:1787388185.992349:0:14986:0:(genops.c:906:class_export_put()) final put ffff9273d0f07000/29e41aeb-8af0-4a54-a54e-7e42c8606c3d 00000020:00000080:1.0:1787388185.992352:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9273d0f07000/29e41aeb-8af0-4a54-a54e-7e42c8606c3d for MGC192.168.204.152@tcp 00000020:01000000:1.0:1787388185.992361:0:14986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.152@tcp (29e41aeb-8af0-4a54-a54e-7e42c8606c3d) 00010000:01000000:0.0:1787388185.992887:0:15760:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787388185.992893:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787388185.992898:0:15760:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787388185.992905:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388185.993020:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388185.993028:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787388185.993035:0:15760:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787388185.993038:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388185.993043:0:15760:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787388185.993049:0:15760:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9272c2fbe800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787388185.993066:0:15760:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9273ef9f19c0) has exports, disconnecting them 00000020:00080000:0.0:1787388185.993071:0:15760:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9272c2fbe800), last request at 1787387964 00000020:00000080:0.0:1787388185.993075:0:15760:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181199c 00000020:00080000:0.0:1787388185.993089:0:15760:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9272c2fbe800): rc 0 00000020:00000080:0.0:1787388185.993094:0:15760:0:(genops.c:906:class_export_put()) final put ffff9272c2fbe800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787388185.994101:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2fbe000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787388185.994114:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2fb8000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787388185.994119:0:14986:0:(genops.c:906:class_export_put()) final put ffff9272c23f7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787388185.994121:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c23f7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787388185.994126:0:14986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787388185.994164:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2fbe800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787388185.994860:0:15760:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787388185.994866:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787388185.994870:0:15760:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787388185.994875:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787388185.994896:0:14986:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9272c2fbc800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787388185.994931:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787388185.996806:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787388185.996920:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787388185.998860:0:7471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:2.0:1787388186.000721:0:10340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:1.0:1787388186.002809:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff927401a12200:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1787388186.017626:0:13193:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9272c2faea00:13193] 2 exiting: rc = 0 00000100:00100000:0.0:1787388186.019928:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9273d138fa00:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1787388186.020068:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020391:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9273c3f37a00:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1787388186.020460:0:7461:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff927401b13a00:7461] 3 exiting: rc = 0 00000100:00100000:0.0:1787388186.020556:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff927401a13000:6506] 1 exiting: rc = 0 00000100:00100000:0.0:1787388186.020648:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff927401a13800:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1787388186.020830:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020838:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020845:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020852:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020871:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020877:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020883:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020889:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020895:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020900:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020906:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020912:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020917:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020924:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020931:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020938:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020945:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020955:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020961:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020967:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020973:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020980:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020987:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.020994:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021003:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021011:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021020:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021033:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021039:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021176:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021187:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021194:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021203:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021211:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021218:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021224:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021237:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021242:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021247:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021260:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021266:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021271:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021277:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021282:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021287:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021292:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021298:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021335:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021341:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021346:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021352:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021357:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021362:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021367:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021373:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021378:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021382:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021387:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021392:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021398:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021402:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021408:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021414:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.021419:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787388186.024634:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388186.024647:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787388186.024653:0:15760:0:(genops.c:906:class_export_put()) final put ffff9272c2fbd000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787388186.024658:0:15760:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c2fbd000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787388186.024663:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787388186.024743:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927401ba8000 1 00000020:00000080:3.0:1787388186.024750:0:15760:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5cb77467b181192c 00000020:00000080:3.0:1787388186.024756:0:15760:0:(genops.c:906:class_export_put()) final put ffff9272c23f5000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787388186.024771:0:15760:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787388186.024775:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388186.024779:0:15760:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787388186.024795:0:15760:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9272c2cdb380) has no exports 00000020:00000080:0.0:1787388186.026515:0:14986:0:(genops.c:865:class_export_destroy()) destroying export ffff9272c23f5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787388186.071865:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388186.071879:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787388186.071884:0:15760:0:(genops.c:906:class_export_put()) final put ffff927401baa000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787388186.071889:0:15760:0:(genops.c:865:class_export_destroy()) destroying export ffff927401baa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787388186.071899:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787388186.072214:0:15760:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff927401baf000 00000020:01000000:2.0:1787388186.072233:0:15760:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787388186.072237:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388186.072240:0:15760:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787388186.072244:0:15760:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9273eedf99c0) has no exports 00000020:00000080:2.0:1787388186.072274:0:15760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388186.072278:0:15760:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787388186.072281:0:15760:0:(genops.c:906:class_export_put()) final put ffff9273fbc53000/OSS_uuid 00000020:00000080:2.0:1787388186.072283:0:15760:0:(genops.c:865:class_export_destroy()) destroying export ffff9273fbc53000/OSS_uuid for OSS 00000020:01000000:2.0:1787388186.072286:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787388186.072448:0:6516:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787388186.072484:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9273eede5800:8436] 1 exiting: rc = 0 00000100:00100000:3.0:1787388186.072507:0:10361:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9273ff9d5200:10361] 3 exiting: rc = 0 00000100:00100000:1.0:1787388186.072863:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9273eeea4800:8437] 2 exiting: rc = 0 00000100:00100000:2.0:1787388186.074781:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9273fbd0cc00:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1787388186.075820:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075830:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075837:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075859:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075867:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075873:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075879:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075887:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075893:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075899:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075904:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075909:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075913:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075919:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075924:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075928:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075933:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075938:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075942:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075948:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075953:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075958:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075978:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075983:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075989:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.075995:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076000:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076006:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076011:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076016:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076021:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076026:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076031:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076037:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076041:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076046:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076054:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076059:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076064:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076069:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076073:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076078:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076082:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076087:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076091:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076095:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076100:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076105:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076110:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076114:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076119:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076124:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076129:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076134:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076138:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076143:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076147:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076160:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076165:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076171:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076176:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076182:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076187:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.076192:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388186.078221:0:8951:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9272c26d2a00:8951] 2 exiting: rc = 0 00000100:00100000:2.0:1787388186.078236:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9273df9ee800:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1787388186.078580:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9273fbca4a00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1787388186.078925:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078934:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078940:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078945:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078950:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078955:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078961:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078966:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078972:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078977:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078982:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078987:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078992:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.078997:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079002:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079007:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079011:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079016:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079021:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079025:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079031:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079036:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079040:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079045:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079050:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079055:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079060:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079066:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079084:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079089:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079094:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079099:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079104:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079109:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079114:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079119:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079124:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079129:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079133:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079138:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079143:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079147:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079151:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079157:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079161:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079166:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079171:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079176:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079182:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079187:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079192:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079197:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079203:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079208:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079213:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079218:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079223:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079227:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079233:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079239:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079244:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079249:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079254:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.079270:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388186.082035:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9273eecf3c00:8441] 1 exiting: rc = 0 00000100:00100000:3.0:1787388186.082215:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9273eecf3000:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1787388186.082482:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9273eecf3400:8442] 2 exiting: rc = 0 00000100:00100000:0.0:1787388186.083018:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083041:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083047:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083053:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083058:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083063:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083069:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083074:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083079:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083084:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083090:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083094:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083099:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083104:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083108:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083113:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083118:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083123:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083128:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083133:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083138:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083144:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083150:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083155:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083160:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083178:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083185:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083190:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083196:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083206:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083211:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083216:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083222:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083228:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083248:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083253:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083259:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083265:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083275:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083281:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083287:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083293:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083299:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083304:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083310:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083315:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083319:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083324:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083331:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083336:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083342:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083348:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083354:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083627:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083643:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083659:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083666:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083816:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083832:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083842:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083848:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083854:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083859:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388186.083874:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.088558:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9273eecf2000:8443] 0 exiting: rc = 1 00000100:00100000:3.0:1787388186.088704:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9273c6380e00:8444] 1 exiting: rc = 0 00000100:00100000:2.0:1787388186.088726:0:8746:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9273eee3d200:8746] 2 exiting: rc = 0 00000100:00100000:1.0:1787388186.088976:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.088983:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.088988:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.088993:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089005:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089010:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089015:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089020:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089025:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089031:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089036:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089041:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089046:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089052:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089057:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089063:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089069:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089074:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089078:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089083:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089089:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089094:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089098:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089103:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089108:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089113:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089118:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089122:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089128:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089133:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089138:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089143:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089148:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089153:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089157:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089162:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089168:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089172:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089177:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089188:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089193:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089198:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089203:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089208:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089213:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089218:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089223:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089228:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089233:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089238:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089243:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089248:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089253:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089258:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089263:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089268:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089273:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089277:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089282:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089289:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089295:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089313:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089318:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.089324:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388186.090260:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9273f5e13a00:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1787388186.090416:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9273f5e13600:8446] 1 exiting: rc = 0 00000100:00100000:1.0:1787388186.090561:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090568:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090574:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090581:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090587:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090593:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090598:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090613:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090620:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090821:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090838:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090844:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090850:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090855:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090861:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090867:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090874:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090879:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090885:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090906:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090914:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090920:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090926:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090932:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090939:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090948:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090954:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090988:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.090995:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091002:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091008:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091089:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091097:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091102:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091109:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091115:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091122:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091128:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091133:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091140:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091145:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091151:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091156:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091175:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091182:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091193:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091198:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091205:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091211:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091218:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091225:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091231:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091237:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091243:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091248:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091267:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091274:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091280:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091286:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091292:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091298:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091304:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091310:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388186.091316:0:15760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787388186.115813:0:15760:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787388206.644575:0:16526:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787388217.738202:0:17125:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787388217.738207:0:17125:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787388217.738209:0:17125:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787388217.738717:0:17125:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff927401a55800 00000020:01000004:1.0:1787388217.738734:0:17125:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787388217.738742:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787388217.738755:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9273ef9f4d40) 00000020:00000080:1.0:1787388217.738770:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787388217.867809:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787388217.869041:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787388217.876091:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787388217.878036:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.878722:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787388217.879570:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.879961:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.880156:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787388217.880413:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.880778:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787388217.880961:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.881148:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787388217.881375:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787388217.881572:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.882245:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.882444:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.882781:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.882967:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.883227:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.883475:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.883912:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.884140:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.884503:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.885088:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.886660:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.887127:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.888554:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.889117:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.889451:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.889871:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.890073:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.890561:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.891256:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.891566:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.891867:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.892373:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.892990:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.893611:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.894071:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.894667:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.895125:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.895351:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.895858:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.896122:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787388217.896390:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.896714:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787388217.898355:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.900587:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.901231:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.901460:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.901995:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.902263:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787388217.902453:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1787388217.903428:0:17125:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787388217.903801:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787388217.903809:0:17125:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787388217.903820:0:17125:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812b70 00000020:01000004:1.0:1787388217.903827:0:17125:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787388217.903832:0:17125:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787388217.903837:0:17125:0:(tgt_mount.c:101:server_register_mount()) register mount ffff927401a55800 from MGS 00000020:01000004:1.0:1787388217.903840:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787388217.903861:0:17125:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9273ef9f19c0) 00000020:00000080:1.0:1787388217.903873:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787388217.903933:0:17125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff927401a55800 from MGS, refs=2 00080000:01000000:1.0:1787388217.903938:0:17125:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787388217.903943:0:17125:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812b7e 00000100:00100000:1.0:1787388217.904038:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787388217.904325:0:17125:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787388217.904332:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787388217.905227:0:17125:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787388217.905235:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787388217.906305:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787388217.906464:0:17125:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787388217.906469:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787388217.907227:0:17125:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787388217.907234:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787388217.907935:0:17125:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787388217.907943:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787388217.908539:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388217.908543:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388217.908544:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388217.908952:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388217.908955:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388217.908957:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388217.909459:0:17125:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787388217.913240:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787388217.915358:0:17125:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787388217.916328:0:17137:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787388217.916373:0:17125:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787388217.916405:0:17125:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787388217.917439:0:17125:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787388217.918033:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787388217.918279:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787388217.918285:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787388217.922715:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787388217.922730:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787388217.923668:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787388217.924059:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787388217.925645:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787388217.925669:0:17125:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.152@tcp' 00000020:01000004:0.0:1787388217.925671:0:17125:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787388217.925728:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.152@tcp (typ=mgc) 00000020:00000080:0.0:1787388217.925740:0:17125:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.152@tcp (ffff9273ff9419c0) 00000020:00000080:0.0:1787388217.925768:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1787388217.926031:0:17142:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1787388217.926265:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c3f03000@MGC192.168.204.152@tcp: add connection 192.168.204.152@tcp at head 00010000:00010000:0.0:1787388217.926409:0:17125:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.152@tcp-0 is initialized 00000040:01000000:0.0:1787388217.926416:0:17125:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787388217.928610:0:17143:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787388217.928663:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.152@tcp (uuid b3be7e40-7086-4e4f-aad1-8d3798e099a7) 00000020:00000080:3.0:1787388217.928709:0:17125:0:(genops.c:1406:class_connect()) connect: client b3be7e40-7086-4e4f-aad1-8d3798e099a7, cookie 0x5cb77467b1812b8c 00000100:00080000:3.0:1787388217.928720:0:17125:0:(import.c:510:import_select_connection()) MGC192.168.204.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388217.928727:0:17125:0:(import.c:624:import_select_connection()) MGC192.168.204.152@tcp: import ffff9272c3f03000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388217.928759:0:17125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7c700 x1874211971959424/t0(0) o250->MGC192.168.204.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388217.928781:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b3be7e40-7086-4e4f-aad1-8d3798e099a7->MGS 00000020:01000004:3.0:1787388217.928799:0:17125:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787388217.928804:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787388217.928815:0:17125:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9272c24199c0) 00000020:00000080:3.0:1787388217.928826:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787388217.934911:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3643:1874211971959424:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787388217.934996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388217.935074:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971959424 00000100:00100000:0.0:1787388217.935083:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971959424 00000100:00100000:0.0:1787388217.935115:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388217.935123:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1874211971959424:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787388217.935169:0:17138:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b3be7e40-7086-4e4f-aad1-8d3798e099a7@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1787388217.935202:0:17138:0:(genops.c:1406:class_connect()) connect: client b3be7e40-7086-4e4f-aad1-8d3798e099a7, cookie 0x5cb77467b1812b9a 00000100:00080000:0.0:1787388217.935572:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9272c3f02000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388217.935626:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+5:3643:x1874211971959424:12345-0@lo:250:mount.lustre.0 Request processed in 503us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388217.935634:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388217.935695:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787388217.935703:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1787388217.935711:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787388217.935716:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787388217.935719:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c3f03000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787388217.935722:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787388217.935725:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787388217.935730:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3643:1874211971959424:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787388217.940339:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388217.940528:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787388217.940536:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787388217.941529:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787388217.941537:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787388217.942194:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787388217.942201:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787388217.942816:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388217.942968:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787388217.942974:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787388217.945348:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787388217.945359:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787388217.988128:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388217.988400:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787388217.988407:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787388217.990101:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787388217.990117:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787388217.990844:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388217.991118:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787388217.991125:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787388217.991826:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787388217.991833:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787388217.992522:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388217.992666:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787388217.992671:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787388217.993491:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787388217.993498:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787388217.994211:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388217.994378:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787388217.994384:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787388217.995173:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787388217.995184:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787388218.017606:0:17125:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388218.018270:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787388218.018277:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787388218.019866:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787388218.019879:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787388218.020665:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787388218.020674:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787388218.021506:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787388218.021535:0:17125:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787388218.021543:0:17125:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787388218.021659:0:17125:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787388218.021729:0:17125:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.152@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787388218.021733:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787388218.021735:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787388218.021737:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388218.021738:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388218.021739:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388218.021740:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388218.021742:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388218.021744:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787388218.021746:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388218.021747:0:17125:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388218.021750:0:17125:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787388218.021752:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388218.021753:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787388218.021754:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388218.021755:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388218.021756:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388218.021758:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388218.021759:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388218.021760:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787388218.021761:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388218.021769:0:17125:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388218.021794:0:17125:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787388218.021814:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388218.021984:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.022026:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787388218.022403:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971959552 00000100:00100000:2.0:1787388218.022410:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971959552 00000100:00100000:2.0:1787388218.022460:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388218.022470:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+5:17125:x1874211971959552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787388218.022519:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787388218.022522:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787388218.022525:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787388218.023105:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787388218.023644:0:17141:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1787388218.029843:0:17163:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787388218.029852:0:17163:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787388218.029855:0:17163:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787388218.029858:0:17163:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787388218.030228:0:17163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787388218.030561:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787388218.030578:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787388218.032616:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+5:17125:x1874211971959552:12345-0@lo:253:mount.lustre.0 Request processed in 10138us (10622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388218.032648:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388218.032967:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787388218.032984:0:17125:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787388218.032988:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787388218.032989:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787388218.032991:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388218.032992:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388218.032994:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388218.032995:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388218.032997:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388218.032998:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787388218.033000:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388218.033001:0:17125:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787388218.033022:0:17125:0:(tgt_mount.c:101:server_register_mount()) register mount ffff927401a55800 from lustre-MDT0000 10000000:01000000:1.0:1787388218.033053:0:17125:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787388218.033056:0:17125:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787388218.033061:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9273ff9419c0 10000000:01000000:1.0:1787388218.033066:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388218.033073:0:17125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9273ff9419c0 from 1 10000000:01000000:1.0:1787388218.033076:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787388218.033110:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.033122:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.033131:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.033234:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388218.033272:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.033364:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.033406:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971959680 00000100:00100000:0.0:1787388218.033412:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971959680 00000100:00100000:0.0:1787388218.033487:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787388218.033496:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+5:17125:x1874211971959680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388218.033509:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388218.033523:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe400/0x5cb77467b1812ba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812ba1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.036538:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe400/0x5cb77467b1812ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812ba1 expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.036559:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe400/0x5cb77467b1812ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812ba1 expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.036569:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe400, rc 0) 00000100:00100000:0.0:1787388218.036663:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+6:17125:x1874211971959680:12345-0@lo:101:mount.lustre.0 Request processed in 3166us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.036671:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388218.036908:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388218.036928:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.036937:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.037136:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388218.037190:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.037269:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.037312:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971959808 00000100:00100000:0.0:1787388218.037319:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971959808 00000100:00100000:0.0:1787388218.037394:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388218.037403:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+6:17125:x1874211971959808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388218.037572:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+6:17125:x1874211971959808:12345-0@lo:501:mount.lustre.0 Request processed in 169us (380us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388218.037579:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388218.037795:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959808:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787388218.037897:0:17125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787388218.037918:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.037927:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388218.037936:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff927401a55800 10000000:01000000:1.0:1787388218.037942:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787388218.037947:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff927401a55800 10000000:01000000:1.0:1787388218.038058:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787388218.038063:0:17125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff927401a55800 from 1 10000000:01000000:1.0:1787388218.038066:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787388218.038092:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038100:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038124:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.038138:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388218.038182:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.038212:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.038249:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971959936 00000100:00100000:0.0:1787388218.038255:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971959936 00000100:00100000:0.0:1787388218.038280:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787388218.038294:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+6:17125:x1874211971959936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388218.038304:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388218.038316:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fea00/0x5cb77467b1812bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812baf expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.038334:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fea00/0x5cb77467b1812bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812baf expref: 7 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.038343:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fea00/0x5cb77467b1812bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812baf expref: 7 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.038352:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fea00, rc 0) 00000100:00100000:0.0:1787388218.038381:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+7:17125:x1874211971959936:12345-0@lo:101:mount.lustre.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.038387:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388218.038397:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971959936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388218.038407:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812bb6 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038415:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812bb6 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388218.038426:0:17125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787388218.038440:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812bb6 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038447:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020000/0x5cb77467b1812baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812bb6 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388218.038453:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787388218.038456:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388218.038469:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff927401a55800 10000000:01000000:1.0:1787388218.038472:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787388218.038475:0:17125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787388218.038477:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787388218.038490:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038503:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038511:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.038524:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971960064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388218.038547:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.038567:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.038638:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971960064 00000100:00100000:0.0:1787388218.038642:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971960064 00000100:00100000:0.0:1787388218.038668:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388218.038675:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+7:17125:x1874211971960064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388218.038715:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388218.038724:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fec00/0x5cb77467b1812bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812bbd expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.038736:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fec00/0x5cb77467b1812bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812bbd expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.038744:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fec00/0x5cb77467b1812bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812bbd expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.038763:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fec00, rc 0) 00000100:00100000:0.0:1787388218.038791:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+8:17125:x1874211971960064:12345-0@lo:101:mount.lustre.0 Request processed in 117us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.038797:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388218.038880:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971960064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388218.038891:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812bc4 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.038899:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812bc4 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.038944:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971960192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388218.039234:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.039262:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.039353:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971960192 00000100:00100000:0.0:1787388218.039357:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971960192 00000100:00100000:0.0:1787388218.039547:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388218.039556:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+8:17125:x1874211971960192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388218.039726:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17125:x1874211971960192:12345-0@lo:501:mount.lustre.0 Request processed in 171us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.039733:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787388218.039807:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971960192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388218.039841:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971960320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388218.039885:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388218.040460:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c32190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.040633:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971960320 00000100:00100000:1.0:1787388218.040640:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971960320 00000100:00100000:1.0:1787388218.040668:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388218.040675:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17125:x1874211971960320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388218.041937:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17125:x1874211971960320:12345-0@lo:503:mount.lustre.0 Request processed in 1255us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.041948:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787388218.042122:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971960320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388218.042808:0:17164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17164:1874211971960448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388218.042862:0:17164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388218.042987:0:17164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c3219f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.043022:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971960448 00000100:00100000:1.0:1787388218.043028:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971960448 00000100:00100000:1.0:1787388218.043104:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787388218.043114:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17164:x1874211971960448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.043936:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17164:x1874211971960448:12345-0@lo:502:llog_process_th.0 Request processed in 820us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.043947:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787388218.044029:0:17164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17164:1874211971960448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388218.044063:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388218.044075:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.044078:0:17164:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787388218.044083:0:17164:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787388218.044086:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787388218.044100:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9272c241b380) 00000020:00000080:3.0:1787388218.044116:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787388218.044121:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787388218.044221:0:17164:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787388218.044229:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812bd2 00000020:00000080:3.0:1787388218.044442:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787388218.044447:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388218.044450:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.044451:0:17164:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787388218.044459:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388218.044463:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.044464:0:17164:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787388218.044468:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787388218.044475:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9272c2418000) 00000020:00000080:3.0:1787388218.044485:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787388218.044489:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787388218.044491:0:17164:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787388218.044493:0:17164:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787388218.044498:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787388218.044561:0:17164:0:(tgt_mount.c:153:server_get_mount()) get mount ffff927401a55800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787388218.044576:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9272c241cd40) 00000020:00000080:3.0:1787388218.044584:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787388218.044633:0:17164:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787388218.044638:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812be7 00000020:00000080:3.0:1787388218.044770:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787388218.044777:0:17164:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787388218.044781:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5cb77467b1812bee 00080000:01000000:3.0:1787388218.044786:0:17164:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787388218.044789:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812bf5 00010000:00010000:3.0:1787388218.096146:0:17164:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787388218.097371:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967530 00000001:00080000:3.0:1787388218.098060:0:17164:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787388218.100307:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9273c4a48000) 00000020:00000080:3.0:1787388218.100335:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787388218.100434:0:17164:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787388218.100442:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812c03 00000020:00000080:3.0:1787388218.106545:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787388218.113488:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5cb77467b1812c0a 00000020:00000080:2.0:1787388218.114675:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787388218.114710:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388218.114718:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.114720:0:17164:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787388218.114722:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787388218.114725:0:17164:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787388218.114726:0:17164:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388218.114728:0:17164:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388218.114729:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787388218.114731:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.114733:0:17164:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787388218.114735:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388218.114740:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.114741:0:17164:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787388218.114745:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787388218.114808:0:17164:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787388218.114836:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388218.114839:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.114840:0:17164:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787388218.114843:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388218.114846:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.114848:0:17164:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787388218.114850:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787388218.114856:0:17164:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:00000080:2.0:1787388218.114900:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388218.114915:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9272c2cdb380) 00000020:00000080:2.0:1787388218.114931:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787388218.114936:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787388218.114991:0:17164:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787388218.114996:0:17164:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787388218.115003:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812c18 00010000:00080000:2.0:1787388218.115039:0:17164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273d0630000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:2.0:1787388218.118657:0:17164:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787388218.120406:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388218.120420:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787388218.120456:0:17164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787388218.120478:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812c1f 00000100:00080000:2.0:1787388218.120489:0:17164:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388218.120495:0:17164:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9273d0630000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787388218.120532:0:17164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3cbad80 x1874211971960576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388218.120610:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971960576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388218.120701:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.120836:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971960576 00000100:00100000:2.0:1787388218.120842:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971960576 00000100:00100000:2.0:1787388218.120881:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388218.120889:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971960576:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787388218.120911:0:17151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787388218.121777:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787388218.121881:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388218.121887:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.121890:0:17164:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787388218.121893:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787388218.121905:0:17164:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787388218.121907:0:17164:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787388218.121909:0:17164:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787388218.121911:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787388218.121914:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.121915:0:17164:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787388218.121918:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787388218.121923:0:17164:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787388218.121926:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.121927:0:17164:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787388218.121930:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787388218.121935:0:17164:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:3.0:1787388218.121961:0:17164:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787388218.121964:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787388218.121979:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9273c4a499c0) 00000020:00000080:3.0:1787388218.121997:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787388218.122001:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787388218.122073:0:17164:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787388218.122080:0:17164:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787388218.122086:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812c2d 00010000:00080000:3.0:1787388218.122120:0:17164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c2371800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787388218.122547:0:17164:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787388218.130086:0:17164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787388218.130786:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787388218.135558:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388218.136853:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787388218.144024:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787388218.157822:0:17170:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787388218.157831:0:17170:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787388218.159301:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787388218.159314:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787388218.159352:0:17164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787388218.159371:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812c34 00000100:00080000:0.0:1787388218.159381:0:17164:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787388218.159387:0:17164:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9272c2371800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388218.159422:0:17164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2711880 x1874211971960704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388218.159458:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971960704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787388218.159516:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971960704 offset 0 length 520: 4 00000100:00080000:0.0:1787388218.159570:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787388218.159645:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388218.159649:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388218.159650:0:17164:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787388218.159653:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787388218.159656:0:17164:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787388218.159657:0:17164:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787388218.159659:0:17164:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787388218.159660:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787388218.159662:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388218.159664:0:17164:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787388218.159666:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787388218.159670:0:17164:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787388218.159673:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388218.159674:0:17164:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787388218.159702:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787388218.159706:0:17164:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:0.0:1787388218.159725:0:17164:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787388218.159727:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787388218.159738:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9273ff943380) 00000020:00000080:0.0:1787388218.159749:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787388218.159753:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787388218.160030:0:17164:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787388218.160036:0:17164:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787388218.160042:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5cb77467b1812c42 00010000:00080000:0.0:1787388218.160070:0:17164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273c9716800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:0.0:1787388218.160898:0:17164:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787388218.160965:0:17164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787388218.160980:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787388218.166788:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971960576:12345-0@lo:38:llog_process_th.0 Request processed in 45893us (46105us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787388218.166806:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787388218.167380:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388218.167401:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787388218.167406:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971960576:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787388218.168746:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388218.169412:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787388218.169607:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787388218.170666:0:17172:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388218.170673:0:17172:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787388218.172571:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388218.172586:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787388218.172641:0:17164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787388218.172662:0:17164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812c49 00000100:00080000:3.0:1787388218.172672:0:17164:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388218.172705:0:17164:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9273c9716800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388218.172741:0:17164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7fb80 x1874211971960832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388218.172760:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787388218.173188:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971960832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787388218.173314:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971960832 offset 0 length 520: 4 00000020:01000000:3.0:1787388218.174752:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388218.174785:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.174788:0:17164:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787388218.174792:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388218.175551:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.175555:0:17164:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787388218.175566:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787388218.175568:0:17164:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787388218.175571:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388218.175574:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.175575:0:17164:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787388218.175577:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388218.175580:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.175581:0:17164:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787388218.175585:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787388218.175643:0:17164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17164:1874211971960960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388218.175758:0:17164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.175960:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971960960 00000100:00100000:2.0:1787388218.175968:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971960960 00000100:00100000:2.0:1787388218.176011:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388218.176020:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17164:x1874211971960960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388218.176145:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17164:x1874211971960960:12345-0@lo:502:llog_process_th.0 Request processed in 126us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388218.176164:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787388218.176711:0:17164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c1359cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388218.176737:0:17164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17164:1874211971960960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388218.177318:0:17164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388218.177326:0:17164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388218.177328:0:17164:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787388218.177333:0:17164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787388218.177726:0:17125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787388218.177750:0:17125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787388218.177893:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812bc4 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.177905:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1021200/0x5cb77467b1812bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812bc4 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388218.177913:0:17125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff927401a55800 from 1 10000000:01000000:1.0:1787388218.177916:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787388218.177949:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.177956:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.177966:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.177985:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388218.178036:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.178066:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4af9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.178111:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961088 00000100:00100000:1.0:1787388218.178118:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961088 00000100:00100000:1.0:1787388218.178170:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388218.178180:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+9:17125:x1874211971961088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388218.178192:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388218.178207:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812c50 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.178240:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.178251:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.178261:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021a00, rc 0) 00000100:00100000:1.0:1787388218.178305:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+10:17125:x1874211971961088:12345-0@lo:101:mount.lustre.0 Request processed in 126us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.178312:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787388218.178335:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388218.178348:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388218.178357:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388218.179557:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961216:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787388218.179613:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.179650:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.179724:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961216 00000100:00100000:0.0:1787388218.179731:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961216 00000100:00100000:0.0:1787388218.179889:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787388218.179899:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+10:17125:x1874211971961216:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787388218.179918:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787388218.179924:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787388218.180007:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+10:17125:x1874211971961216:12345-0@lo:256:mount.lustre.0 Request processed in 109us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.180015:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388218.180108:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961216:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787388218.180863:0:17125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787388218.180884:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.180895:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388218.180903:0:17125:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401a55800 from 1 10000000:01000000:2.0:1787388218.180905:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388218.180936:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.180944:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.181005:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388218.181021:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388218.181059:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.181665:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.181864:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961344 00000100:00100000:1.0:1787388218.181871:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961344 00000100:00100000:1.0:1787388218.181908:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787388218.181916:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+10:17125:x1874211971961344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388218.181928:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388218.181943:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812c5e expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.181966:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.181975:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.181992:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020200, rc 0) 00000100:00100000:1.0:1787388218.182030:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17125:x1874211971961344:12345-0@lo:101:mount.lustre.0 Request processed in 115us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.182037:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388218.182276:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388218.182290:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.182299:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388218.182365:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388218.182394:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.182418:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.182535:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961472 00000100:00100000:1.0:1787388218.182539:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961472 00000100:00100000:1.0:1787388218.182558:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787388218.182564:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17125:x1874211971961472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388218.182827:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17125:x1874211971961472:12345-0@lo:501:mount.lustre.0 Request processed in 262us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.182835:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787388218.182966:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388218.182993:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388218.183031:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.183058:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.183123:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961600 00000100:00100000:0.0:1787388218.183128:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961600 00000100:00100000:0.0:1787388218.183151:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787388218.183168:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17125:x1874211971961600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388218.183484:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17125:x1874211971961600:12345-0@lo:503:mount.lustre.0 Request processed in 317us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.183491:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787388218.183569:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388218.184184:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17174:1874211971961728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388218.184369:0:17174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388218.184406:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.184463:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961728 00000100:00100000:1.0:1787388218.184469:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961728 00000100:00100000:1.0:1787388218.184507:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388218.184515:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17174:x1874211971961728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.185252:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17174:x1874211971961728:12345-0@lo:502:llog_process_th.0 Request processed in 736us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.185261:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388218.187482:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17174:1874211971961728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388218.187552:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388218.187566:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.187577:0:17174:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787388218.187586:0:17174:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff927401a55800 00000020:00000080:2.0:1787388218.187589:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388218.187597:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388218.187599:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.187600:0:17174:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787388218.187603:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388218.187605:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.187607:0:17174:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787388218.187610:0:17174:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff927401a55800 00000020:00000080:2.0:1787388218.187612:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388218.188814:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388218.188822:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.188824:0:17174:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787388218.188827:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388218.188830:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.188832:0:17174:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388218.188836:0:17174:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927401a55800 00000020:00000080:2.0:1787388218.188838:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388218.188861:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388218.188865:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.188866:0:17174:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388218.188869:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388218.188871:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.188872:0:17174:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787388218.188876:0:17174:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927401a55800 00000020:00000080:2.0:1787388218.188878:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787388218.188932:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17174:1874211971961856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388218.189011:0:17174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.189061:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.189258:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961856 00000100:00100000:1.0:1787388218.189265:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961856 00000100:00100000:1.0:1787388218.189319:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388218.189328:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17174:x1874211971961856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.189443:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17174:x1874211971961856:12345-0@lo:502:llog_process_th.0 Request processed in 116us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.189451:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787388218.189611:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17174:1874211971961856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388218.189727:0:17174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388218.189736:0:17174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388218.189737:0:17174:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388218.189740:0:17174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787388218.190030:0:17125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787388218.190306:0:17125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388218.190330:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388218.190342:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388218.190391:0:17125:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787388218.190394:0:17125:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff927401a55800 10000000:01000000:3.0:1787388218.190396:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff927401a55800 10000000:01000000:3.0:1787388218.190400:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787388218.190405:0:17125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff927401a55800 from 1 10000000:01000000:3.0:1787388218.190408:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787388218.190435:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388218.190443:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388218.190539:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388218.190556:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787388218.190595:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388218.190618:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388218.190730:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971961984 00000100:00100000:2.0:1787388218.190735:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971961984 00000100:00100000:2.0:1787388218.190769:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787388218.190777:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17125:x1874211971961984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388218.190787:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388218.190926:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c3709e00/0x5cb77467b1812c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812c6c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.190950:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3709e00/0x5cb77467b1812c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812c6c expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.190961:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c3709e00/0x5cb77467b1812c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c6c expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.190969:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709e00, rc 0) 00000100:00100000:2.0:1787388218.191005:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971961984:12345-0@lo:101:mount.lustre.0 Request processed in 227us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388218.191011:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787388218.191196:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971961984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388218.191209:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c73 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388218.191219:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812c73 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388218.191393:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971962112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388218.191420:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388218.191447:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388218.191579:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962112 00000100:00100000:2.0:1787388218.191584:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962112 00000100:00100000:2.0:1787388218.191618:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787388218.191625:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971962112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388218.191775:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971962112:12345-0@lo:501:mount.lustre.0 Request processed in 148us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388218.191782:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787388218.191860:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971962112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388218.192035:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971962240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388218.192769:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.193047:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962240 00000100:00100000:2.0:1787388218.193059:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962240 00000100:00100000:2.0:1787388218.193467:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c4e1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388218.193527:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787388218.193535:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971962240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388218.193639:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971962240:12345-0@lo:503:mount.lustre.0 Request processed in 104us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388218.193646:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787388218.193709:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971962240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388218.197041:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17177:1874211971962368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388218.197133:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388218.197190:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388218.199328:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962368 00000100:00100000:2.0:1787388218.199343:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962368 00000100:00100000:2.0:1787388218.199398:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388218.199407:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17177:x1874211971962368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388218.200978:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17177:x1874211971962368:12345-0@lo:502:llog_process_th.0 Request processed in 1564us (3837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388218.200991:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787388218.201593:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17177:1874211971962368:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787388218.201780:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787388218.201805:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9273ff940000) 00000020:00000080:0.0:1787388218.201830:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787388218.202008:0:17177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff927401a55800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787388218.202013:0:17177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927401a55800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787388218.202016:0:17177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927401a55800 4 00010000:00080000:0.0:1787388218.202059:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273c97bb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.152@tcp at head 00010000:00010000:0.0:1787388218.204411:0:17177:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787388218.204514:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787388218.204558:0:17177:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787388218.204571:0:17177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5cb77467b1812c81 00000100:00080000:0.0:1787388218.204582:0:17177:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787388218.204587:0:17177:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9273c97bb800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388218.204892:0:17177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2710e00 x1874211971962496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388218.204929:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971962496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388218.204995:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388218.205068:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962496 00000100:00100000:0.0:1787388218.205076:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962496 00000100:00080000:1.0:1787388218.205733:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787388218.206010:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388218.206018:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971962496:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388218.206085:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971962496:12345-0@lo:38:llog_process_th.0 Request processed in 65us (1089us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787388218.206093:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388218.206434:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388218.206443:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273c97bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388218.206452:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787388218.206456:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971962496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388218.207980:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17177:1874211971962624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388218.208048:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388218.208089:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962624 00000100:00100000:0.0:1787388218.208095:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962624 00000100:00100000:0.0:1787388218.208134:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787388218.208142:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17177:x1874211971962624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.208743:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.208910:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17177:x1874211971962624:12345-0@lo:502:llog_process_th.0 Request processed in 766us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.208918:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787388218.209001:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17177:1874211971962624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.209046:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17177:1874211971962752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.209083:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388218.209104:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eeef3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388218.209118:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962752 00000100:00100000:1.0:1787388218.209122:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962752 00000100:00100000:1.0:1787388218.209163:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787388218.209171:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17177:x1874211971962752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388218.209261:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17177:x1874211971962752:12345-0@lo:502:llog_process_th.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.209268:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787388218.209303:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17177:1874211971962752:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787388218.209322:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787388218.209497:0:17125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787388218.209520:0:17125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787388218.209536:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c73 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388218.209548:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c0031200/0x5cb77467b1812c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c73 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787388218.209590:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787388218.209592:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388218.209594:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388218.209595:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388218.209596:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388218.209597:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388218.209598:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388218.209599:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388218.209601:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388218.209602:0:17125:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787388218.209605:0:17125:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787388218.209612:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787388218.209613:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388218.209614:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388218.209615:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388218.209616:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388218.209617:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388218.209618:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388218.209619:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388218.209620:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388218.209621:0:17125:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787388218.210124:0:17125:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787388218.210137:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971962880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787388218.210191:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388218.210214:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30bb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388218.210301:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971962880 00000100:00100000:0.0:1787388218.210307:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971962880 00000100:00100000:0.0:1787388218.211763:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787388218.211777:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971962880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787388218.211805:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787388218.211819:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787388218.214093:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787388218.214114:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787388218.214366:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787388218.214371:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787388218.214390:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.214408:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.214416:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388218.214431:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17125:x1874211971962880:12345-0@lo:253:mount.lustre.0 Request processed in 2656us (4237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388218.214440:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787388218.214451:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388218.214505:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17125:1874211971962880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787388218.214519:0:17125:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787388218.214522:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787388218.214524:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388218.214525:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388218.214526:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388218.214527:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388218.214535:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388218.214536:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388218.214538:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388218.214540:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388218.214541:0:17125:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787388218.214551:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 11 pid: 17138 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1787388218.214560:0:17125:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787388218.214563:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971963008:0@lo:104: 00000100:00100000:2.0:1787388218.214593:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388218.214623:0:17162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c96c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388218.214658:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963008 00000100:00100000:2.0:1787388218.214663:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963008 00000100:00100000:2.0:1787388218.214717:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388218.214725:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971963008:12345-0@lo:104: 00010000:00010000:2.0:1787388218.214737:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.215015:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388218.215021:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971963008:12345-0@lo:104: Request processed in 298us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388218.215027:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787388218.215053:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388218.215060:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388218.215068:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971963008:0@lo:104: 00010000:00010000:1.0:1787388218.215068:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021c00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388218.215072:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215081:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388218.215089:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388218.215101:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787388218.215130:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215137:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388218.215165:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215173:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273d1021c00/0x5cb77467b1812c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c57 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215188:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388218.215189:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388218.215191:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388218.215215:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388218.215233:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971963136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388218.215263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388218.215293:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.215306:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963136 00000100:00100000:1.0:1787388218.215310:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963136 00010000:00010000:1.0:1787388218.215326:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 12 pid: 17138 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.215345:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787388218.215351:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:3646:x1874211971963136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388218.215360:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388218.215365:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 12 pid: 17138 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215375:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 12 pid: 17138 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215394:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812c50 expref: 12 pid: 17138 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215406:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215413:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787388218.215424:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001054267s 00010000:00010000:1.0:1787388218.215428:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215435:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215442:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215449:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215454:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388218.215458:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215465:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215482:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.215488:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388218.215496:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388218.215498:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388218.215502:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c3709c00/0x5cb77467b1812c88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388218.215526:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:3646:x1874211971963136:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388218.215533:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787388218.215560:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971963136:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787388218.243469:0:17125:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787388218.245857:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787388218.245873:0:17186:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787388218.245879:0:17186:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787388218.247200:0:17187:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787388218.247953:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787388218.249757:0:17187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787388218.251831:0:17188:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9272c3cabb80 x1874211971963264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388218.251847:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000040:01000000:2.0:1787388218.253122:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787388218.253182:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787388218.253790:0:17125:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787388218.253798:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787388218.253831:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388218.255378:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787388218.255704:0:17187:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787388218.255762:0:17187:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787388218.260061:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787388218.260209:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787388218.262979:0:17125:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1787388218.267776:0:17125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787388218.272504:0:17125:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787388218.272541:0:17125:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0cc16b7988 00100000:10000000:0.0:1787388218.272549:0:17125:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787388218.274610:0:17125:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787388218.274627:0:17125:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787388218.274647:0:17125:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787388218.274667:0:17125:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787388218.275749:0:17125:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388218.276001:0:17125:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787388218.951920:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388219.273169:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787388219.273490:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 10000000:01000000:3.0:1787388219.655886:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787388219.655894:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff927401a55800 from 7 10000000:01000000:3.0:1787388219.655899:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787388219.655953:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388219.655965:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388219.655976:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388219.656001:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971963392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388219.656064:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388219.656149:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76a5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388219.659472:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963392 00000100:00100000:1.0:1787388219.659485:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963392 00000100:00100000:2.0:1787388219.660767:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787388219.660781:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+11:17143:x1874211971963392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388219.660797:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388219.660829:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812c8f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388219.660858:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388219.660872:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388219.660881:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709600, rc 0) 00000100:00100000:2.0:1787388219.660959:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17143:x1874211971963392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388219.660966:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787388219.661021:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971963392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388219.661038:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388219.661060:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388219.661122:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971963520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787388219.661171:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388219.661199:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388219.661298:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963520 00000100:00100000:0.0:1787388219.661304:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963520 00000100:00100000:0.0:1787388219.661352:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787388219.661582:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17143:x1874211971963520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787388219.661601:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787388219.661620:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787388219.661624:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787388219.661739:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17143:x1874211971963520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 380us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388219.661747:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787388219.662731:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971963520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388219.662787:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388219.662795:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388219.662807:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388219.976795:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388220.296300:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388220.297938:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:1.0:1787388221.001800:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388221.319879:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:3.0:1787388222.023864:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388222.344736:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000001:02000400:2.0:1787388223.012499:0:17431:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787388223.051256:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388223.369971:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000100:00080000:3.0:1787388223.499826:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787388223.499834:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787388223.499837:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388223.499846:0:14986:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1787388223.499852:0:14986:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388223.499859:0:14986:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9273d0630000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388223.499883:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7f800 x1874211971963776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388223.499893:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1787388223.499901:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388223.499905:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388223.499907:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787388223.499907:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971963648:0@lo:400:kworker.0 00000100:00080000:3.0:1787388223.499910:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388223.499913:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787388223.499923:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787388223.499924:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273c97bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388223.499929:0:14986:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9273c97bb800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388223.499942:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7f100 x1874211971963904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388223.499974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388223.499982:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971963776:0@lo:38:kworker.0 00000100:00100000:3.0:1787388223.500018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388223.500031:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963648 00000100:00100000:1.0:1787388223.500038:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963648 00000100:00100000:3.0:1787388223.500041:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971963904:0@lo:38:kworker.0 00000100:00100000:3.0:1787388223.500084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388223.500095:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787388223.500103:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:3645:x1874211971963648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388223.500120:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963776 00000100:00100000:3.0:1787388223.500123:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963776 00000100:00100000:3.0:1787388223.500144:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787388223.500149:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874211971963776:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787388223.500150:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:3645:x1874211971963648:12345-0@lo:400:kworker.0 Request processed in 48us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388223.500156:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00020000:3.0:1787388223.500164:0:17152:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388223.500216:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963904 00000100:00100000:1.0:1787388223.500220:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963904 00000100:00100000:1.0:1787388223.500240:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388223.500245:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874211971963904:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787388223.500261:0:17148:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1787388223.500298:0:17148:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5cb77467b1812c9d 00000004:00100000:1.0:1787388223.500312:0:17148:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787388223.500440:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9273fbca8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388223.500480:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874211971963904:12345-0@lo:38:kworker.0 Request processed in 232us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388223.500496:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388223.500535:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971963648:0@lo:400:kworker.0 00010000:00080000:2.0:1787388223.515852:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9273ffa7f100 x1874211971963904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388223.515875:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787388223.515884:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787388223.515890:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787388223.515894:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273c97bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787388223.515901:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874211971963904:0@lo:38:kworker.0 00000100:00100000:2.0:1787388223.522143:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874211971963776:12345-0@lo:38:kworker.0 Request processed in 21986us (22118us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787388223.522158:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787388223.522231:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388223.522236:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787388223.522241:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971963776:0@lo:38:kworker.0 00000020:00000004:1.0:1787388224.035009:0:17483:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388224.035206:0:17483:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388224.078009:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388224.391957:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000020:00000004:3.0:1787388224.973593:0:17533:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388224.974001:0:17533:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787388225.095929:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388225.416824:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:1.0:1787388226.120834:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388226.440745:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:3.0:1787388227.155853:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388227.463806:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:1.0:1787388228.167881:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388228.489354:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000100:00100000:2.0:1787388228.615758:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388218/real 1787388218] req@ffff9273ffa7fb80 x1874211971960832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388228 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388228.615788:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7fb80 x1874211971960832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388228 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388228.615799:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388218/real 1787388218] req@ffff9272c2711880 x1874211971960704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388228 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388228.615835:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c2711880 x1874211971960704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388228 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388228.615853:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388228.615875:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388228.615879:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971960832:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787388228.615885:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388228.615890:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388228.615893:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971960704:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787388228.616046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787388228.616051:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787388228.616054:0:36:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388228.616058:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1787388228.616070:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787388228.616077:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9273d0630000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388228.616097:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7e300 x1874211971964160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388228.616111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388228.616114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787388228.616116:0:36:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388228.616119:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1787388228.616121:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388228.616124:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9272c2371800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388228.616134:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7c700 x1874211971964288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388228.616142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388228.616145:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787388228.616146:0:36:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388228.616149:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1787388228.616151:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388228.616154:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9273c9716800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388228.616163:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7e680 x1874211971964416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388228.616210:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388228.616221:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971964032:0@lo:400:kworker.0 00000100:00100000:3.0:1787388228.616279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388228.616332:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388228.616340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971964544:0@lo:400:kworker.0 00000100:00100000:3.0:1787388228.616371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388228.616396:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971964160:0@lo:38:kworker.0 00000100:00100000:3.0:1787388228.616418:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388228.616432:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971964288:0@lo:8:kworker.0 00000400:00000100:3.0:1787388228.616464:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971964288 offset 0 length 520: 4 00000100:00100000:3.0:1787388228.616476:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971964416:0@lo:8:kworker.0 00000400:00000100:3.0:1787388228.616491:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971964416 offset 0 length 520: 4 00000100:00100000:2.0:1787388228.616729:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971964032 00000100:00100000:2.0:1787388228.616737:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971964032 00000100:00100000:2.0:1787388228.616786:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388228.616794:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:3644:x1874211971964032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388228.616850:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:3644:x1874211971964032:12345-0@lo:400:kworker.0 Request processed in 56us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388228.616857:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787388228.616870:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971964032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388228.616887:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971964160 00000100:00100000:2.0:1787388228.616891:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971964160 00000100:00100000:2.0:1787388228.616909:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787388228.616914:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971964160:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787388228.616930:0:17151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388228.617001:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971964544 00000100:00100000:1.0:1787388228.617006:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971964544 00000100:00100000:1.0:1787388228.617078:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787388228.617085:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971964544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388228.617126:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971964544:12345-0@lo:400:kworker.0 Request processed in 41us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388228.617132:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787388228.617767:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9273ffa7f480 x1874211971964544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388228.617788:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971964544:0@lo:400:kworker.0 00000100:00100000:2.0:1787388228.636307:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971964160:12345-0@lo:38:kworker.0 Request processed in 19383us (19878us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787388228.636323:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787388228.639335:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388228.639346:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787388228.639351:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971964160:0@lo:38:kworker.0 00010000:00010000:1.0:1787388229.193930:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388229.514109:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:1.0:1787388230.215981:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388230.535764:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000040:00080000:0.0:1787388230.537319:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388231.240556:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388231.561785:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000020:01000004:2.0:1787388231.653084:0:17878:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787388231.653089:0:17878:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787388231.653091:0:17878:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787388231.653204:0:17878:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9273c2f5e000 00000020:01000004:2.0:1787388231.653220:0:17878:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787388231.653235:0:17878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787388231.653250:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9272c2cdcd40) 00000020:00000080:2.0:1787388231.653272:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787388231.735631:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787388231.736750:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.739777:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.740262:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.741198:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787388231.741545:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787388231.741792:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787388231.742009:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.743920:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.744463:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787388231.744858:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.745557:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787388231.745979:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787388231.746424:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787388231.750486:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.751738:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.752235:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.752564:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.753571:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.755373:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.756241:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.756707:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.756943:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.757223:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.757550:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.757761:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.758165:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.758553:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.758878:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.759382:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.759781:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.760025:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.760453:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787388231.760831:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787388231.761284:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787388231.761872:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787388231.762108:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787388231.762289:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787388231.762918:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787388231.763108:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787388231.763412:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787388231.763672:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787388231.764025:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787388231.764243:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787388231.764548:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787388231.764789:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787388231.766269:0:17878:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787388231.766827:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787388231.766840:0:17878:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787388231.766942:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1812cab 00000020:01000004:0.0:1787388231.766950:0:17878:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787388231.766973:0:17878:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787388231.766976:0:17878:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787388231.766983:0:17878:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787388231.767013:0:17878:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787388231.767017:0:17878:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787388231.772253:0:17878:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787388231.772293:0:17878:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.152@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787388231.772297:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787388231.772403:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787388231.772405:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388231.772406:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388231.772407:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388231.772408:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388231.772410:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388231.772417:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388231.772418:0:17878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388231.772422:0:17878:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787388231.772424:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388231.772426:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787388231.772426:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388231.772427:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388231.772428:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388231.772429:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388231.772430:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388231.772431:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388231.772432:0:17878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388231.772458:0:17878:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787388231.772545:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971964672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388231.772618:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388231.772737:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2fa9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388231.772817:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971964672 00000100:00100000:0.0:1787388231.772825:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971964672 00000100:00100000:1.0:1787388231.779027:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787388231.779042:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17878:x1874211971964672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787388231.779113:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787388231.779117:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787388231.779125:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787388231.780248:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17878:x1874211971964672:12345-0@lo:253:mount.lustre.0 Request processed in 1205us (7625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.780258:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388231.780426:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971964672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787388231.780440:0:17878:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787388231.780443:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787388231.780445:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787388231.780446:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388231.780447:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388231.780459:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388231.780460:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388231.780461:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787388231.780462:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388231.780464:0:17878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787388231.780495:0:17878:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9273c2f5e000 from lustre-MDT0001 10000000:01000000:2.0:1787388231.780524:0:17878:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787388231.780527:0:17878:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787388231.780533:0:17878:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9273ff9419c0 local copy 00010000:00010000:2.0:1787388231.780542:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388231.780636:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971964800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388231.780670:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.780759:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388231.781355:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971964800 00000100:00100000:0.0:1787388231.781363:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971964800 00000100:00100000:0.0:1787388231.781412:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787388231.781420:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17878:x1874211971964800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388231.781509:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17878:x1874211971964800:12345-0@lo:501:mount.lustre.0 Request processed in 90us (838us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388231.781516:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388231.781573:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971964800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787388231.781588:0:17878:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787388231.781612:0:17878:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787388231.781619:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.781628:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388231.781656:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9273c2f5e000 10000000:01000000:2.0:1787388231.781661:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787388231.781666:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9273ff9419c0 10000000:01000000:2.0:1787388231.781669:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787388231.781672:0:17878:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9273ff9419c0 from 1 10000000:01000000:2.0:1787388231.781675:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787388231.781734:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.781752:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.781762:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388231.781777:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971964928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388231.781806:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.782345:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388231.783230:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971964928 00000100:00100000:3.0:1787388231.783238:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971964928 00000100:00100000:3.0:1787388231.783363:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388231.783374:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+12:17878:x1874211971964928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388231.783387:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388231.783409:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0030e00/0x5cb77467b1812cb9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812cb2 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.783449:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0030e00/0x5cb77467b1812cb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812cb2 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.783460:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0030e00/0x5cb77467b1812cb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812cb2 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.783475:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030e00, rc 0) 00000100:00100000:3.0:1787388231.783540:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+13:17878:x1874211971964928:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388231.783546:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787388231.783629:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971964928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388231.783643:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cb9 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.783652:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812cb9 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388231.783672:0:17878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787388231.783701:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cb9 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.783708:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708e00/0x5cb77467b1812cb2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cb9 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388231.783716:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9273c2f5e000 10000000:01000000:2.0:1787388231.783721:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787388231.783726:0:17878:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9273c2f5e000 from 1 10000000:01000000:2.0:1787388231.783728:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787388231.783755:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.783764:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.783771:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388231.783789:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388231.783825:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.786745:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388231.786871:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965056 00000100:00100000:1.0:1787388231.786881:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965056 00000100:00100000:1.0:1787388231.786939:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787388231.786948:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+13:17878:x1874211971965056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388231.786963:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388231.786981:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812cc0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.787035:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812cc0 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.787047:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273d1021a00/0x5cb77467b1812cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812cc0 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.787055:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021a00, rc 0) 00000100:00100000:1.0:1787388231.787113:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+14:17878:x1874211971965056:12345-0@lo:101:mount.lustre.0 Request processed in 165us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.787119:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787388231.787260:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388231.787276:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cc7 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.787286:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812cc7 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388231.787303:0:17878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787388231.787332:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cc7 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.787341:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708c00/0x5cb77467b1812cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cc7 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388231.787348:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787388231.787361:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787388231.787368:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9273c2f5e000 10000000:01000000:2.0:1787388231.787377:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787388231.787381:0:17878:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787388231.787383:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787388231.787408:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.787415:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.787423:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388231.787444:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388231.787480:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.787498:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388231.787718:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965184 00000100:00100000:1.0:1787388231.787724:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965184 00000100:00100000:1.0:1787388231.787743:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787388231.787749:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+14:17878:x1874211971965184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388231.787756:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388231.787767:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273d1021000/0x5cb77467b1812cd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812cce expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.787781:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1021000/0x5cb77467b1812cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812cce expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.787790:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273d1021000/0x5cb77467b1812cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812cce expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.787795:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021000, rc 0) 00000100:00100000:1.0:1787388231.787832:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965184:12345-0@lo:101:mount.lustre.0 Request processed in 82us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.787837:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787388231.787923:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388231.787934:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cd5 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.787940:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812cd5 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388231.791337:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787388231.792075:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388231.800530:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787388231.800594:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787388231.800612:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787388231.800623:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787388231.800634:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787388231.800645:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787388231.800655:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787388231.800666:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787388231.800704:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787388231.800724:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787388231.800738:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787388231.800750:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787388231.800763:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787388231.800776:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787388231.800789:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787388231.800801:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787388231.800812:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787388231.800825:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787388231.800838:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787388231.800851:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787388231.800864:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787388231.800877:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787388231.800903:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787388231.800934:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787388231.800942:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787388231.801052:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388231.801132:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388231.801186:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2fa9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388231.801322:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965312 00000100:00100000:2.0:1787388231.801330:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965312 00000100:00100000:2.0:1787388231.801392:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787388231.801402:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388231.801549:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965312:12345-0@lo:501:mount.lustre.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388231.801557:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787388231.801939:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388231.801982:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388231.802494:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388231.802527:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2fa9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388231.802568:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965440 00000100:00100000:2.0:1787388231.802573:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965440 00000100:00100000:2.0:1787388231.802607:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787388231.802615:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388231.803490:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965440:12345-0@lo:503:mount.lustre.0 Request processed in 873us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388231.803498:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787388231.803605:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388231.804290:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388231.804487:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388231.804540:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388231.804615:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c53c9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388231.806103:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965568 00000100:00100000:0.0:1787388231.806117:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965568 00000100:00100000:1.0:1787388231.806244:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787388231.806255:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388231.807137:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965568:12345-0@lo:502:mount.lustre.0 Request processed in 881us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.807148:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787388231.807264:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388231.807623:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787388231.807658:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1787388231.807673:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1787388231.807879:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1787388231.807908:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1787388231.807922:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1787388231.807932:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1787388231.807942:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1787388231.807951:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1787388231.807961:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1787388231.807970:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1787388231.807981:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1787388231.807996:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1787388231.808009:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1787388231.808021:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1787388231.808033:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1787388231.808046:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1787388231.808057:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1787388231.808084:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1787388231.808099:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1787388231.808111:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1787388231.808122:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1787388231.808147:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1787388231.808161:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1787388231.808175:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1787388231.808185:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1787388231.808196:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1787388231.808207:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1787388231.808218:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1787388231.808229:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1787388231.808240:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1787388231.808250:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1787388231.808261:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1787388231.808271:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1787388231.808297:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1787388231.809076:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1787388231.809092:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1787388231.809103:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1787388231.809115:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1787388231.809125:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1787388231.809137:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1787388231.809150:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1787388231.809164:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1787388231.809176:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1787388231.809220:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388231.809296:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.809503:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388231.809569:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965696 00000100:00100000:1.0:1787388231.809577:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965696 00000100:00100000:1.0:1787388231.809672:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787388231.809706:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388231.809831:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971965696:12345-0@lo:502:mount.lustre.0 Request processed in 150us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.809839:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388231.809939:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971965696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388231.809991:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1787388231.810000:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787388231.810776:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388231.810787:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388231.810790:0:17882:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787388231.810802:0:17882:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787388231.810805:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388231.810818:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9272c2cd99c0) 00000020:00000080:2.0:1787388231.810841:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787388231.810846:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787388231.810937:0:17882:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787388231.810944:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1812ce3 00000020:00000080:2.0:1787388231.811149:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787388231.811153:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388231.811157:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388231.811159:0:17882:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787388231.811162:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388231.811166:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388231.811167:0:17882:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787388231.811170:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388231.811177:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9272c2cd8000) 00000020:00000080:2.0:1787388231.811186:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787388231.811189:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787388231.811191:0:17882:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787388231.811194:0:17882:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787388231.811199:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787388231.811254:0:17882:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273c2f5e000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787388231.811268:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9273fb15cd40) 00000020:00000080:2.0:1787388231.811277:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787388231.811345:0:17882:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787388231.811350:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812cf8 00000020:00000080:2.0:1787388231.811587:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787388231.811594:0:17882:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787388231.811599:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5cb77467b1812cff 00080000:01000000:2.0:1787388231.811604:0:17882:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787388231.811607:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1812d06 00010000:00010000:1.0:1787388231.919831:0:17882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1787388231.920766:0:17882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1787388231.922451:0:17882:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787388231.925279:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787388231.925293:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388231.925308:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388231.925311:0:17882:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787388231.925315:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388231.925322:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388231.925323:0:17882:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787388231.925327:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787388231.925332:0:17882:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:00000080:1.0:1787388231.925371:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388231.925385:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9273ef9f3380) 00000020:00000080:1.0:1787388231.925408:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1787388231.925414:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787388231.925506:0:17882:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787388231.925513:0:17882:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787388231.925520:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1812d14 00010000:00080000:1.0:1787388231.925554:0:17882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273eecb1000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:1.0:1787388231.932045:0:17882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787388231.949734:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388231.949751:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787388231.949837:0:17882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787388231.949861:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812d1b 00000100:00080000:3.0:1787388231.949873:0:17882:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388231.949879:0:17882:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9273eecb1000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388231.949929:0:17882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7e300 x1874211971965824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388231.949956:0:17882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787388231.950215:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388231.950220:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388231.950222:0:17882:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787388231.950225:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787388231.950227:0:17882:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787388231.950229:0:17882:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787388231.950230:0:17882:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787388231.950231:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787388231.950234:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388231.950241:0:17882:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787388231.950244:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388231.950248:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388231.950249:0:17882:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787388231.950253:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787388231.950289:0:17882:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787388231.950302:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388231.950305:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388231.950306:0:17882:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787388231.950308:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787388231.950310:0:17882:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787388231.950311:0:17882:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787388231.950312:0:17882:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787388231.950313:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787388231.950315:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388231.950317:0:17882:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787388231.950319:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787388231.950322:0:17882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787388231.950326:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388231.950327:0:17882:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787388231.950330:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787388231.950334:0:17882:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:3.0:1787388231.950358:0:17882:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787388231.950360:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787388231.950373:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9273c4a4b380) 00000020:00000080:3.0:1787388231.950386:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787388231.950391:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787388231.950445:0:17882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787388231.950451:0:17882:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787388231.950459:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1812d29 00010000:00080000:3.0:1787388231.950488:0:17882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273eeed4800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787388231.950676:0:17882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1787388231.951045:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787388231.951051:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787388231.951054:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388231.951059:0:14986:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1787388231.951065:0:14986:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787388231.951069:0:14986:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9273d0630000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388231.951091:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3ca8380 x1874211971965952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388231.951103:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388231.951106:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388231.951108:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388231.951112:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388231.951168:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388231.951182:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971966080:0@lo:400:kworker.0 00000100:00100000:1.0:1787388231.951251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388231.951318:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971966080 00000100:00100000:1.0:1787388231.951326:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971966080 00000100:00100000:1.0:1787388231.951377:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388231.951386:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971966080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388231.951437:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971966080:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.951446:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787388231.951487:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9272c3ca9f80 x1874211971966080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388231.951500:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971966080:0@lo:400:kworker.0 00000100:00100000:0.0:1787388231.952018:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971965824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388231.952061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388231.952091:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971965952:0@lo:38:kworker.0 00000100:00100000:0.0:1787388231.952114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388231.952146:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965824 00000100:00100000:0.0:1787388231.952159:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965824 00000100:00100000:0.0:1787388231.952175:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971965952 00000100:00100000:0.0:1787388231.952178:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971965952 00000100:00100000:0.0:1787388231.952189:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388231.952194:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874211971965824:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787388231.952215:0:17152:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:0.0:1787388231.952247:0:17152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812d30 00000004:00100000:0.0:1787388231.952264:0:17152:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787388231.952270:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1787388231.953782:0:17882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787388231.954334:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787388231.968026:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388231.968381:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787388231.968507:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1787388231.969026:0:17887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388231.969038:0:17887:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787388231.972157:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787388231.972173:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787388231.972215:0:17882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787388231.972240:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812d37 00000100:00080000:1.0:1787388231.972250:0:17882:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787388231.972256:0:17882:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9273eeed4800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388231.972292:0:17882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3ca9f80 x1874211971966208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388231.972321:0:17882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787388231.972400:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388231.972405:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388231.972406:0:17882:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787388231.972409:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787388231.972412:0:17882:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787388231.972413:0:17882:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388231.972415:0:17882:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388231.972416:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787388231.972418:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388231.972419:0:17882:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787388231.972421:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787388231.972425:0:17882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787388231.972428:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388231.972429:0:17882:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787388231.972432:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787388231.972435:0:17882:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.152@tcp to nid 0x20000c0a8cc98 (192.168.204.152@tcp) 00000020:01000000:1.0:1787388231.972459:0:17882:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787388231.972461:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388231.972473:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9273ef9f0000) 00000020:00000080:1.0:1787388231.972485:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787388231.972489:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:3.0:1787388231.972527:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388231.972532:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388231.972535:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388231.972537:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:1.0:1787388231.972555:0:17882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787388231.972562:0:17882:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787388231.972568:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5cb77467b1812d45 00010000:00080000:1.0:1787388231.972597:0:17882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9273eecb0000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:1.0:1787388231.972825:0:17882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787388231.972905:0:17882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787388231.972921:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1787388231.973407:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971966208:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787388231.973461:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971966208 offset 0 length 520: 4 00000100:00080000:0.0:1787388231.974786:0:17152:0:(import.c:65:import_set_state_nolock()) ffff9273c8ad4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388231.974896:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1874211971965824:12345-0@lo:38:llog_process_th.0 Request processed in 22699us (22832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388231.974907:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388231.974935:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787388231.974942:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874211971965952:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787388231.975053:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388231.975062:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787388231.975071:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787388231.975076:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787388231.975078:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eecb1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787388231.975088:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971965824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787388231.975100:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388231.975104:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388231.975108:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787388231.975111:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971965952:0@lo:38:kworker.0 00000100:00100000:0.0:1787388231.975164:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874211971965952:12345-0@lo:38:kworker.0 Request processed in 41us (22868us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787388231.975172:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388231.975807:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971966336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388231.975849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.975908:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971966336 00000100:00100000:2.0:1787388231.975916:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971966336 00000100:00100000:2.0:1787388231.975960:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388231.975967:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971966336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388231.976009:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388231.976062:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971966336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388231.976069:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787388231.976138:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971966336:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787388231.979499:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787388231.981866:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787388231.982098:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787388231.982619:0:17889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388231.982625:0:17889:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787388231.983422:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787388231.983437:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787388231.983477:0:17882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787388231.983499:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812d4c 00000100:00080000:0.0:1787388231.983510:0:17882:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787388231.983524:0:17882:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9273eecb0000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388231.983562:0:17882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2710000 x1874211971966464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388231.983627:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971966464:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787388231.983712:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971966464 offset 0 length 520: 4 00000100:00080000:0.0:1787388231.983782:0:17882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787388231.983854:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388231.983859:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388231.983861:0:17882:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787388231.983865:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388231.983869:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388231.983871:0:17882:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787388231.983874:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787388231.983875:0:17882:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787388231.983878:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388231.983880:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388231.983891:0:17882:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787388231.983895:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388231.983898:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388231.983899:0:17882:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787388231.983902:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787388231.983927:0:17882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388231.983931:0:17882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388231.983932:0:17882:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787388231.983935:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1787388231.984010:0:17878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787388231.984040:0:17878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787388231.984057:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cd5 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388231.984067:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708600/0x5cb77467b1812cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812cd5 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388231.984074:0:17878:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c2f5e000 from 1 10000000:01000000:0.0:1787388231.984084:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787388231.984111:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388231.984118:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388231.984128:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388231.984143:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787388231.984181:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388231.984198:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1840 going to sleep for 11 seconds 00000100:00080000:1.0:1787388231.984481:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388231.984486:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388231.984489:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388231.984499:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388231.984520:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971966592 00000100:00100000:1.0:1787388231.984527:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971966592 00000100:00100000:1.0:1787388231.984573:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787388231.984584:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+15:17878:x1874211971966592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388231.984599:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388231.984613:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812d53 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.984637:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 16 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.984649:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 16 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388231.984657:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021400, rc 0) 00000100:00100000:1.0:1787388231.984730:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:17878:x1874211971966592:12345-0@lo:101:mount.lustre.0 Request processed in 147us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.984736:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787388231.984950:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388231.984966:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388231.984974:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388231.986481:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966720:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787388231.986545:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388231.986628:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388231.987762:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971966720 00000100:00100000:1.0:1787388231.987774:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971966720 00000100:00100000:0.0:1787388231.988742:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787388231.988754:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:17878:x1874211971966720:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787388231.988780:0:17141:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787388231.988807:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787388231.988821:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787388231.988967:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:17878:x1874211971966720:12345-0@lo:256:mount.lustre.0 Request processed in 215us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388231.988975:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787388231.989189:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966720:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787388231.989807:0:17878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787388231.989835:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.989845:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388231.989854:0:17878:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c2f5e000 from 1 10000000:01000000:2.0:1787388231.989856:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388231.989898:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.989907:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388231.989917:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388231.989937:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388231.989994:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.990031:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388231.990597:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971966848 00000100:00100000:3.0:1787388231.990612:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971966848 00000100:00100000:3.0:1787388231.990665:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787388231.990674:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:17878:x1874211971966848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388231.990709:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388231.990722:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812d61 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.990744:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.990754:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.990762:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0030600, rc 0) 00000100:00100000:3.0:1787388231.990823:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971966848:12345-0@lo:101:mount.lustre.0 Request processed in 138us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388231.990829:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787388231.990903:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388231.990917:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388231.990925:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388231.991100:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787388231.991139:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388231.991169:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388231.991191:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0662300 going to sleep for 11 seconds 00000100:00100000:3.0:1787388231.991211:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971966976 00000100:00100000:3.0:1787388231.991215:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971966976 00000100:00100000:3.0:1787388231.991233:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787388231.991239:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971966976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388231.991322:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971966976:12345-0@lo:501:mount.lustre.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388231.991329:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787388231.991373:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971966976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388231.991397:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388231.991435:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388231.991448:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0662300 going to sleep for 11 seconds 00000100:00100000:3.0:1787388231.991460:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967104 00000100:00100000:3.0:1787388231.991464:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967104 00000100:00100000:3.0:1787388231.991481:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787388231.991487:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388231.991555:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967104:12345-0@lo:503:mount.lustre.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388231.991562:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787388231.991600:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787388231.991976:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787388231.992043:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388231.992078:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388231.992095:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0662e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388231.992108:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967232 00000100:00100000:3.0:1787388231.992112:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967232 00000100:00100000:3.0:1787388231.992130:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787388231.992141:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388231.992212:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967232:12345-0@lo:502:mount.lustre.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388231.992219:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787388231.992256:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787388231.992475:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787388231.992501:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1787388231.992516:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1787388231.992531:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1787388231.992542:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1787388231.992555:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1787388231.992568:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1787388231.992582:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1787388231.992596:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787388231.992611:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1787388231.992623:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1787388231.992655:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388231.992711:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388231.992725:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0662e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388231.992738:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967360 00000100:00100000:3.0:1787388231.992741:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967360 00000100:00100000:3.0:1787388231.992759:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787388231.992765:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388231.992824:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967360:12345-0@lo:502:mount.lustre.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388231.992830:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787388231.992864:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787388231.992916:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1787388231.992924:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787388232.000575:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388232.000591:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.000593:0:17891:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787388232.000605:0:17891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273c2f5e000 00000020:00000080:0.0:1787388232.000608:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388232.000618:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388232.000621:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.000623:0:17891:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787388232.000625:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388232.000627:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.000629:0:17891:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787388232.000632:0:17891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273c2f5e000 00000020:00000080:0.0:1787388232.000634:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388232.001195:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388232.001202:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.001203:0:17891:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787388232.001206:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388232.001208:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.001209:0:17891:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388232.001213:0:17891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273c2f5e000 00000020:00000080:0.0:1787388232.001214:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388232.016997:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388232.017095:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.017098:0:17891:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388232.017105:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388232.017109:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.017110:0:17891:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787388232.017116:0:17891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273c2f5e000 00000020:00000080:0.0:1787388232.017118:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388232.017184:0:17891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388232.017194:0:17891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388232.017195:0:17891:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787388232.017199:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787388232.017939:0:17878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787388232.017977:0:17878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388232.018933:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.018947:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388232.019972:0:17878:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787388232.019978:0:17878:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9273c2f5e000 10000000:01000000:3.0:1787388232.020203:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9273c2f5e000 10000000:01000000:3.0:1787388232.020209:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787388232.020218:0:17878:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273c2f5e000 from 1 10000000:01000000:3.0:1787388232.020221:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787388232.020272:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.020285:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.020298:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388232.020327:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787388232.021521:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388232.021567:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0662300 going to sleep for 11 seconds 00000100:00100000:3.0:1787388232.021599:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967488 00000100:00100000:3.0:1787388232.021613:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967488 00000100:00100000:3.0:1787388232.024967:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787388232.025003:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17878:x1874211971967488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388232.025022:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388232.025043:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0031400/0x5cb77467b1812d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812d6f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.025073:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0031400/0x5cb77467b1812d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812d6f expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.025084:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0031400/0x5cb77467b1812d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d6f expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.025092:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031400, rc 0) 00000100:00100000:3.0:1787388232.025177:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967488:12345-0@lo:101:mount.lustre.0 Request processed in 195us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388232.025185:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388232.025220:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388232.025241:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d76 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.025252:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812d76 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388232.039095:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787388232.039436:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388232.039641:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787388232.039668:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787388232.039716:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787388232.039733:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787388232.039746:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787388232.039775:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787388232.039800:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787388232.039827:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787388232.039844:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787388232.039855:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787388232.039868:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787388232.039893:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787388232.039909:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787388232.039923:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787388232.039936:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787388232.039948:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787388232.039960:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787388232.039973:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787388232.039986:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787388232.040000:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787388232.040013:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787388232.040042:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787388232.040060:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787388232.040075:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787388232.040087:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787388232.040100:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787388232.040113:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787388232.040126:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787388232.040145:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787388232.040150:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787388232.040229:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388232.040298:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.040347:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d13c33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388232.040861:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967616 00000100:00100000:0.0:1787388232.040870:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967616 00000100:00100000:0.0:1787388232.040941:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787388232.040950:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388232.041103:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967616:12345-0@lo:501:mount.lustre.0 Request processed in 153us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388232.041112:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787388232.041164:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388232.041204:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388232.041246:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388232.041270:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388232.041544:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967744 00000100:00100000:3.0:1787388232.041549:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967744 00000100:00100000:3.0:1787388232.041586:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787388232.041593:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388232.041706:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967744:12345-0@lo:503:mount.lustre.0 Request processed in 84us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388232.041714:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787388232.043967:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967744:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787388232.044507:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787388232.044592:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388232.044664:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388232.044735:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388232.045553:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971967872 00000100:00100000:1.0:1787388232.045563:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971967872 00000100:00100000:1.0:1787388232.045624:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388232.045633:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388232.045804:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971967872:12345-0@lo:502:mount.lustre.0 Request processed in 171us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.045824:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787388232.048145:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971967872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388232.049543:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787388232.049587:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787388232.049598:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787388232.049611:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787388232.049622:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787388232.049632:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787388232.049652:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787388232.049663:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787388232.049673:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787388232.049699:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787388232.049711:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787388232.049722:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787388232.049733:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787388232.049744:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787388232.049754:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787388232.049765:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787388232.049792:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787388232.049804:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787388232.049827:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787388232.049839:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787388232.049849:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787388232.049860:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787388232.049870:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787388232.049891:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787388232.049905:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787388232.049916:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787388232.049926:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787388232.049937:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787388232.049947:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787388232.049957:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787388232.049968:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787388232.049978:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787388232.052545:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787388232.052569:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787388232.052583:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787388232.052596:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787388232.052610:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787388232.052625:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787388232.052639:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787388232.052663:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787388232.052676:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787388232.052720:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787388232.052733:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787388232.052745:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787388232.052756:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787388232.052767:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787388232.052781:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787388232.052795:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787388232.055847:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971968000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388232.055946:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.056005:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d13c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787388232.057162:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968000 00000100:00100000:0.0:1787388232.057174:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968000 00000100:00100000:0.0:1787388232.057234:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787388232.057244:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971968000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388232.057491:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971968000:12345-0@lo:502:mount.lustre.0 Request processed in 248us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388232.057499:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787388232.057563:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971968000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388232.057786:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1787388232.059481:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1787388232.059557:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971968128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388232.059644:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388232.059723:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44540 going to sleep for 11 seconds 00000100:00100000:1.0:1787388232.060595:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968128 00000100:00100000:1.0:1787388232.060605:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968128 00000100:00100000:1.0:1787388232.060650:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388232.060657:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971968128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388232.060802:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971968128:12345-0@lo:502:mount.lustre.0 Request processed in 144us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.060820:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787388232.062597:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971968128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388232.062703:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1787388232.062717:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787388232.078244:0:17897:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787388232.078260:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9273c4a4cd40) 00000020:00000080:3.0:1787388232.078284:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787388232.079825:0:17897:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273c2f5e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787388232.079834:0:17897:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273c2f5e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787388232.079841:0:17897:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273c2f5e000 3 00010000:00080000:3.0:1787388232.079879:0:17897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c36ce800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.152@tcp at head 00010000:00010000:3.0:1787388232.091253:0:17897:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787388232.091619:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787388232.091674:0:17897:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787388232.091915:0:17897:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5cb77467b1812d84 00000100:00080000:3.0:1787388232.091928:0:17897:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388232.091935:0:17897:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9272c36ce800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388232.091972:0:17897:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7df80 x1874211971968256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388232.092002:0:17897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787388232.092179:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874211971968256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787388232.092245:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388232.092363:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787388232.092369:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787388232.092371:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388232.092377:0:14986:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9273d0630000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388232.092394:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3ca8380 x1874211971968384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388232.092414:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388232.092417:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388232.092420:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388232.092423:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388232.092458:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388232.092470:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388232.092473:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388232.092476:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388232.092603:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971968512:0@lo:400:kworker.0 00000100:00100000:1.0:1787388232.092633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.092663:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971968640:0@lo:400:kworker.0 00000100:00100000:1.0:1787388232.092712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.092749:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968256 00000100:00100000:1.0:1787388232.092757:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968256 00000100:00100000:1.0:1787388232.092785:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968512 00000100:00100000:1.0:1787388232.092787:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968512 00000100:00100000:1.0:1787388232.092812:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388232.092821:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971968512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388232.092869:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971968512:12345-0@lo:400:kworker.0 Request processed in 49us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.092877:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388232.092902:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388232.092907:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971968256:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787388232.092925:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:1.0:1787388232.092951:0:17146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5cb77467b1812d8b 00000004:00100000:1.0:1787388232.092964:0:17146:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787388232.093080:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971968384:0@lo:38:kworker.0 00000100:00100000:2.0:1787388232.093111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388232.093191:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9272c23f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388232.093235:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874211971968256:12345-0@lo:38:llog_process_th.0 Request processed in 327us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.093242:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388232.093274:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968640 00000100:00100000:1.0:1787388232.093278:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968640 00000100:00100000:1.0:1787388232.093296:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968384 00000100:00100000:1.0:1787388232.093298:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968384 00000100:00100000:1.0:1787388232.093308:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388232.093314:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971968640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388232.093352:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211971968640:12345-0@lo:400:kworker.0 Request processed in 38us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.093358:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388232.093370:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388232.093374:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971968384:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787388232.093406:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874211971968384:12345-0@lo:38:kworker.0 Request processed in 30us (294us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787388232.093413:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787388232.093448:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9272c3caa680 x1874211971968512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388232.093460:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971968512:0@lo:400:kworker.0 00000100:00100000:1.0:1787388232.093486:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971968640:0@lo:400:kworker.0 00000100:00080000:2.0:1787388232.094235:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388232.094242:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787388232.094245:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971968384:0@lo:38:kworker.0 00010000:00080000:2.0:1787388232.094258:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9273ffa7df80 x1874211971968256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388232.094266:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388232.094273:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787388232.094281:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787388232.094287:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787388232.094289:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c36ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787388232.094295:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874211971968256:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787388232.094568:0:17897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1787388232.096902:0:17878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787388232.096951:0:17878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787388232.096969:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d76 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.098225:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273c0030400/0x5cb77467b1812d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812d76 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787388232.098296:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787388232.098303:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787388232.098304:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388232.098305:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388232.098306:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388232.098308:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388232.098309:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388232.098311:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388232.098312:0:17878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787388232.098316:0:17878:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787388232.098318:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388232.098319:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787388232.098320:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388232.098321:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388232.098322:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388232.098323:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388232.098324:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388232.098325:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388232.098325:0:17878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787388232.103600:0:17878:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787388232.103630:0:17878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971968768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388232.103726:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.103818:0:17878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d13c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388232.103947:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968768 00000100:00100000:0.0:1787388232.103955:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968768 00000100:00100000:0.0:1787388232.104047:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787388232.104063:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17878:x1874211971968768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787388232.104095:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787388232.104110:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787388232.108779:0:17126:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787388232.109416:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787388232.109443:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787388232.110314:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787388232.110321:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787388232.110361:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110380:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110387:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110394:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110435:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110450:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 18 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388232.110465:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971968896:0@lo:104: 00000100:00100000:2.0:1787388232.110527:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388232.110588:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110597:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 18 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388232.110605:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971969024:0@lo:104: 00000100:00100000:2.0:1787388232.110626:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388232.110645:0:17162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c390b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388232.110668:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971968896 00000100:00100000:2.0:1787388232.110675:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971968896 00000100:00100000:2.0:1787388232.110732:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969024 00000100:00100000:2.0:1787388232.110736:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969024 00000100:00100000:2.0:1787388232.110751:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388232.110759:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:17162:x1874211971968896:12345-0@lo:104: 00010000:00010000:2.0:1787388232.110771:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110825:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388232.110831:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:17162:x1874211971968896:12345-0@lo:104: Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388232.110838:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388232.110855:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787388232.110861:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971969024:12345-0@lo:104: 00010000:00010000:2.0:1787388232.110868:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.110898:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388232.110905:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.110909:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787388232.110913:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ffa00 already unused, calling callback (ffffffffc1250c20) 00000100:00100000:2.0:1787388232.110914:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971969024:12345-0@lo:104: Request processed in 53us (287us total) trans 0 rc 0/0 10000000:00010000:1.0:1787388232.110917:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388232.110919:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787388232.110925:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388232.110933:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388232.110948:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787388232.110950:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971968896:0@lo:104: 00000100:00100000:2.0:1787388232.110957:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971969024:0@lo:104: 00010000:00010000:2.0:1787388232.110972:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.110973:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.110980:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388232.110998:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111005:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ffa00/0x5cb77467b1812d53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812d5a expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111017:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388232.111021:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111026:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031600 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388232.111029:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111035:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388232.111041:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388232.111045:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787388232.111057:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111062:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388232.111094:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111101:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273c0031600/0x5cb77467b1812c8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111114:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388232.111116:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388232.111117:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388232.111123:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388232.111134:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971969152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388232.111164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.111192:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388232.111204:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971969280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388232.111226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.111250:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969152 00000100:00100000:1.0:1787388232.111254:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969152 00010000:00010000:1.0:1787388232.111272:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 19 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388232.111288:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969280 00000100:00100000:1.0:1787388232.111291:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969280 00010000:00010000:1.0:1787388232.111313:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 20 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388232.111321:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:17878:x1874211971968768:12345-0@lo:253:mount.lustre.0 Request processed in 7259us (7595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.111325:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388232.111330:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388232.111331:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:3647:x1874211971969152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388232.111339:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388232.111344:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 19 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111364:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 19 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111376:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273d1021400/0x5cb77467b1812d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812d53 expref: 19 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388232.111381:0:17878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17878:1874211971968768:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1787388232.111386:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1787388232.111389:0:17878:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787388232.111392:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787388232.111394:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787388232.111395:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388232.111397:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388232.111398:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388232.111399:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388232.111401:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388232.111403:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388232.111404:0:17878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787388232.111410:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:3647:x1874211971969152:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.111416:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:02000000:0.0:1787388232.111416:0:17878:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787388232.111441:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388232.111446:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:3645:x1874211971969280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388232.111453:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388232.111466:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 17 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111476:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 17 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111487:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c3709600/0x5cb77467b1812c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812c8f expref: 17 pid: 17138 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111496:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111502:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787388232.111514:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001192506s 00010000:00010000:1.0:1787388232.111525:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111532:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111538:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111544:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111550:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388232.111554:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111561:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111576:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111585:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388232.111611:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:3645:x1874211971969280:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.111617:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388232.111647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971969152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388232.111665:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971969280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388232.111698:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111715:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.111722:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c3709200/0x5cb77467b1812d92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1787388232.146487:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787388232.146701:0:17903:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787388232.146706:0:17903:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787388232.147126:0:17904:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787388232.147308:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1787388232.148014:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787388232.150371:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17905:1874211971969408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787388232.150486:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388232.150526:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c390b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388232.150583:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969408 00000100:00100000:0.0:1787388232.150590:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969408 00000100:00100000:0.0:1787388232.150645:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787388232.150654:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17905:x1874211971969408:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787388232.150780:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17905:x1874211971969408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388232.150789:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:3.0:1787388232.151039:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787388232.151111:0:17904:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1787388232.151202:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17905:1874211971969408:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787388232.151234:0:17905:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787388232.151267:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17905:1874211971969536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787388232.151299:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388232.151323:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c390b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388232.151475:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969536 00000100:00100000:0.0:1787388232.151481:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969536 00000100:00100000:0.0:1787388232.151511:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787388232.151518:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17905:x1874211971969536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787388232.151632:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17905:x1874211971969536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388232.151639:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:01000000:1.0:1787388232.151948:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787388232.151985:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787388232.152484:0:17878:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787388232.152490:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787388232.152522:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388232.154221:0:17878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787388232.154704:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17905:1874211971969536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787388232.154803:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17905:1874211971969664:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787388232.154867:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388232.154915:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388232.154924:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969664 00000100:00100000:0.0:1787388232.154931:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969664 00000040:00080000:2.0:1787388232.155109:0:17878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787388232.155153:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787388232.155357:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787388232.155501:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388232.155512:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1874211971969664:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787388232.155583:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1874211971969664:12345-0@lo:900:lod0001_rec0000.0 Request processed in 74us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388232.155590:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:2.0:1787388232.156142:0:17878:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1787388232.161265:0:17878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1787388232.161345:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9273ffa7ca80 x1874211971969664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787388248 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388232.161363:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17905:1874211971969664:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787388232.161446:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17905:1874211971969792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787388232.161521:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388232.161564:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388232.161790:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969792 00000100:00100000:1.0:1787388232.161797:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969792 00000100:00100000:1.0:1787388232.161857:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388232.161865:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17905:x1874211971969792:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787388232.161956:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17905:x1874211971969792:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 91us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388232.161964:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787388232.162734:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17905:1874211971969792:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787388232.162799:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787388232.164819:0:17878:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787388232.164859:0:17878:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae0cc0d1f988 00100000:10000000:2.0:1787388232.164868:0:17878:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787388232.166169:0:17878:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787388232.166203:0:17878:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787388232.166226:0:17878:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787388232.166246:0:17878:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1787388232.169088:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787388232.169173:0:17905:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787388232.169179:0:17905:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:1.0:1787388232.182506:0:17878:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388232.183139:0:17878:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787388232.264875:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388232.584830:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000040:00080000:0.0:1787388233.168360:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787388233.287775:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787388233.287783:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c2f5e000 from 8 10000000:01000000:0.0:1787388233.287788:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787388233.287838:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388233.287873:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388233.287886:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388233.287917:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971969920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388233.288004:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388233.288065:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c53b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388233.288199:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971969920 00000100:00100000:3.0:1787388233.288209:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971969920 00000100:00100000:3.0:1787388233.288264:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388233.288275:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:17143:x1874211971969920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388233.288290:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388233.288304:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812d99 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.288328:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.288340:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.288351:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c0031600, rc 0) 00000100:00100000:3.0:1787388233.288396:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971969920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388233.288404:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388233.288453:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971969920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388233.288468:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.288486:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388233.288538:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971970048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787388233.288571:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388233.288587:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388233.288601:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970048 00000100:00100000:3.0:1787388233.288604:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970048 00000100:00100000:3.0:1787388233.288629:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388233.288635:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971970048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388233.288648:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388233.288664:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388233.288667:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787388233.288760:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971970048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388233.288768:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388233.288798:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971970048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787388233.288841:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787388233.288925:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.288936:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388233.288946:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787388233.288948:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff927401a55800 from 8 10000000:01000000:3.0:1787388233.288956:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787388233.292344:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.292364:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.292377:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388233.292409:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971970176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388233.292493:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388233.292546:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388233.295389:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970176 00000100:00100000:0.0:1787388233.295427:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970176 00000100:00100000:0.0:1787388233.295495:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787388233.295507:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971970176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388233.295523:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388233.295544:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812da7 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388233.295576:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388233.295588:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388233.295599:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff000, rc 0) 00000100:00100000:0.0:1787388233.295707:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971970176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388233.295715:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787388233.295925:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971970176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388233.295946:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388233.295957:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388233.296028:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971970304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388233.296072:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388233.296098:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef58900 going to sleep for 11 seconds 00000100:00100000:3.0:1787388233.296312:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970304 00000100:00100000:3.0:1787388233.296317:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970304 00000100:00100000:3.0:1787388233.296356:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787388233.296364:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971970304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388233.296378:0:17141:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388233.296394:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388233.296398:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787388233.296485:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971970304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388233.296493:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787388233.296525:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971970304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787388233.296570:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787388233.296577:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388233.296586:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388233.301643:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388233.607820:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000040:00080000:2.0:1787388234.184544:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388234.317723:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388234.635120:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:1.0:1787388235.336535:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388235.657652:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00010000:00010000:3.0:1787388236.360327:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388236.680859:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 0 seconds 00000100:00080000:3.0:1787388237.321954:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787388237.321963:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787388237.321968:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388237.321983:0:14986:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9273d0630000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388237.322009:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7d880 x1874211971970560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388237.322029:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388237.322033:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388237.322037:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388237.322040:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388237.322064:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388237.322068:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388237.322071:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388237.322074:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388237.322121:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971970944:0@lo:400:kworker.0 00000100:00100000:3.0:1787388237.322207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388237.322271:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388237.322278:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971970432:0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.322439:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971970688:0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.322468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388237.322489:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388237.322494:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971970816:0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.322516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388237.322565:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970944 00000100:00100000:1.0:1787388237.322574:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970944 00000100:00100000:1.0:1787388237.322634:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970688 00000100:00100000:1.0:1787388237.322638:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970688 00000100:00100000:1.0:1787388237.322654:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388237.322662:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971970944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.322729:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971970944:12345-0@lo:400:kworker.0 Request processed in 67us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.322737:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388237.322756:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388237.322762:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.322801:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971970688:12345-0@lo:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.322807:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388237.322825:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970816 00000100:00100000:1.0:1787388237.322828:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970816 00000100:00100000:1.0:1787388237.322851:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388237.322858:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971970816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.322911:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971970816:12345-0@lo:400:kworker.0 Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.322918:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388237.322962:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971970816:0@lo:400:kworker.0 00010000:00080000:1.0:1787388237.322974:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273ffa7ca80 x1874211971970688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388237.322983:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971970688:0@lo:400:kworker.0 00000100:00100000:0.0:1787388237.322991:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971971072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388237.323018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388237.323033:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971072 00000100:00100000:1.0:1787388237.323037:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971072 00000100:00100000:0.0:1787388237.323060:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787388237.323068:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971971072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388237.323095:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388237.323137:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971971072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388237.323143:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787388237.323237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971971072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388237.323262:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971970560:0@lo:38:kworker.0 00000100:00100000:2.0:1787388237.323292:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388237.323724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787388237.323756:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273ffa7f800 x1874211971970944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388237.323790:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971970944:0@lo:400:kworker.0 00000100:00100000:1.0:1787388237.324108:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970560 00000100:00100000:1.0:1787388237.324113:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970560 00000100:00100000:1.0:1787388237.324148:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787388237.324154:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874211971970560:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787388237.324195:0:17152:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1787388237.324228:0:17152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812db5 00000004:00100000:1.0:1787388237.324243:0:17152:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787388237.324248:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787388237.325069:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971970432 00000100:00100000:2.0:1787388237.325077:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971970432 00000100:00100000:2.0:1787388237.325131:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388237.325140:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:3644:x1874211971970432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388237.325221:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:3644:x1874211971970432:12345-0@lo:400:kworker.0 Request processed in 82us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388237.325229:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388237.325276:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971970432:0@lo:400:kworker.0 00000100:00080000:1.0:1787388237.332973:0:17152:0:(import.c:65:import_set_state_nolock()) ffff9272c23f2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388237.333137:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874211971970560:12345-0@lo:38:kworker.0 Request processed in 8979us (9841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.333147:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787388237.333446:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787388237.333456:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787388237.333462:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787388237.333465:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273d0630000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787388237.333489:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f05c069e): req@ffff9272c3cabb80 x1874211971963264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388237.333512:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971970560:0@lo:38:kworker.0 00000100:00100000:1.0:1787388237.334157:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388237.334171:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971971200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388237.334212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388237.334476:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388237.334503:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787388237.334524:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971200 00000100:00100000:2.0:1787388237.334532:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971200 00000100:00100000:2.0:1787388237.334569:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971963264 00000100:00100000:2.0:1787388237.334573:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971963264 00000100:00100000:2.0:1787388237.334767:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787388237.334792:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971971200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388237.334824:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388237.334874:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971971200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.335526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971971200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388237.338737:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787388237.340547:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787388237.340570:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17188:x1874211971963264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787388237.340715:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17188:x1874211971963264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 156us (6346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388237.340723:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787388237.340787:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1874211971963264:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787388237.340830:0:17188:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787388237.340876:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1874211971971328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787388237.340916:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388237.340948:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787388237.344952:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971328 00000100:00100000:1.0:1787388237.344967:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971328 00000100:00100000:1.0:1787388237.345043:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388237.345054:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17188:x1874211971971328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787388237.345260:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17188:x1874211971971328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 208us (4344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.345269:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787388237.345470:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1874211971971328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787388237.345583:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1874211971971456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787388237.345951:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388237.345974:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c6bdf540 going to sleep for 11 seconds 00000100:00100000:1.0:1787388237.348336:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971456 00000100:00100000:1.0:1787388237.348351:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971456 00000100:00100000:1.0:1787388237.348405:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388237.348414:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17188:x1874211971971456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787388237.348543:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17188:x1874211971971456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388237.348552:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787388237.348735:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1874211971971456:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787388237.348813:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388237.354468:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787388237.354568:0:17188:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1787388237.354573:0:17188:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787388237.386762:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787388237.875019:0:18148:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787388238.408613:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388238.832439:0:18200:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388238.832886:0:18200:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388239.432982:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388239.869380:0:18250:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388239.869671:0:18250:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388240.461608:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388240.776527:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1787388240.862846:0:18299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd0f1d83b0 00000020:00000080:0.0:1787388240.862864:0:18299:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787388240.862869:0:18299:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787388240.862876:0:18299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0f1da640 20000000:00000080:0.0:1787388240.862883:0:18299:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9273f5d42400 uarg=0000000000000000 20000000:01000000:0.0:1787388240.862926:0:18299:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787388240.862933:0:18299:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787388240.862937:0:18299:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787388240.863389:0:18300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787388240.863819:0:18299:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787388240.872030:0:18299:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787388240.872063:0:18299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388240.872083:0:18299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388240.872091:0:18299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388240.872098:0:18299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388240.872144:0:18299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388240.872159:0:18299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 17 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388240.872174:0:18299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1874211971971584:0@lo:104: 00000100:00100000:0.0:1787388240.872250:0:18299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388240.872372:0:18299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388240.872380:0:18299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 17 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388240.872389:0:18299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1874211971971712:0@lo:104: 00000100:00100000:0.0:1787388240.872412:0:18299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388240.872753:0:18299:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d1ea3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787388240.873251:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971584 00000100:00100000:2.0:1787388240.873262:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971584 00000100:00100000:2.0:1787388240.873309:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971712 00000100:00100000:2.0:1787388240.873313:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971712 00000100:00100000:2.0:1787388240.873330:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787388240.873339:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:18299:x1874211971971584:12345-0@lo:104: 00010000:00010000:2.0:1787388240.873354:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873425:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388240.873432:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:18299:x1874211971971584:12345-0@lo:104: Request processed in 94us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.873439:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787388240.873468:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787388240.873474:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:18299:x1874211971971712:12345-0@lo:104: 00010000:00010000:2.0:1787388240.873482:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388240.873658:0:18299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1874211971971584:0@lo:104: 00010000:00010000:2.0:1787388240.873778:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388240.873785:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:18299:x1874211971971712:12345-0@lo:104: Request processed in 311us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.873792:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787388240.873811:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388240.873817:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873825:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388240.873829:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873839:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388240.873846:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388240.873852:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388240.873897:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873904:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388240.873928:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873935:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812d61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812d68 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873958:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388240.873961:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873967:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388240.873970:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.873976:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388240.873983:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388240.873988:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388240.874003:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.874008:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388240.874024:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.874031:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812c5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812c65 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388240.874043:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388240.874045:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388240.874047:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388240.874054:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388240.874075:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388240.874089:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971971840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388240.874123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.874150:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971971968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388240.874169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388240.874238:0:18299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1874211971971712:0@lo:104: 00010000:00010000:3.0:1787388240.874259:0:18299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388240.876027:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971840 00000100:00100000:3.0:1787388240.876042:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971840 00010000:00010000:3.0:1787388240.876075:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 18 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388240.876103:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971971968 00000100:00100000:3.0:1787388240.876106:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971971968 00010000:00010000:3.0:1787388240.876118:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 19 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388240.876151:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388240.876159:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:3646:x1874211971971840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388240.876171:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388240.876177:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 19 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876188:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 19 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876204:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0030600/0x5cb77467b1812d68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812d61 expref: 19 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876219:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388240.876292:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:3646:x1874211971971840:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388240.876299:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388240.876315:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388240.876321:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:3644:x1874211971971968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388240.876330:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388240.876334:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 17 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876343:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 17 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876352:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273d1020200/0x5cb77467b1812c65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812c5e expref: 17 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876373:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876380:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876396:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876404:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876410:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876417:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876422:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388240.876427:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876435:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876461:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876472:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388240.876511:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:3644:x1874211971971968:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388240.876523:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787388240.876557:0:18299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876566:0:18299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388240.876572:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe200/0x5cb77467b1812dbc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388240.877583:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971971968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388240.877621:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971971840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388241.418612:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388231/real 1787388231] req@ffff9272c2710000 x1874211971966464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388241 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388241.418645:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c2710000 x1874211971966464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388241.418656:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388231/real 1787388231] req@ffff9272c3ca9f80 x1874211971966208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388241 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388241.418670:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c3ca9f80 x1874211971966208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787388241.420255:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388241.420734:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787388241.420740:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971966464:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787388241.420749:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eeed4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388241.423590:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388241.423611:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388241.423615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388241.423618:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388241.423634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388241.423637:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787388241.423641:0:36:0:(import.c:65:import_set_state_nolock()) ffff9273eeed4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388241.423649:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787388241.423655:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787388241.423663:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9273eeed4800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388241.423716:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2711f80 x1874211971972608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787388241.423729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388241.423732:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787388241.423734:0:36:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388241.423738:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787388241.423749:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787388241.423753:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9273eecb0000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:0.0:1787388241.423765:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c2713b80 x1874211971972736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388241.423817:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971972480:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.423891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388241.423938:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787388241.423945:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971972096:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.423977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388241.424004:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971972864:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.424034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388241.424062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971972224:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.424085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388241.424103:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388241.424108:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971972352:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.424130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388241.424158:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971972096 00000100:00100000:0.0:1787388241.424165:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971972096 00000100:00100000:2.0:1787388241.424206:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971972480 00000100:00100000:0.0:1787388241.424209:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388241.424210:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971972480 00000100:00100000:0.0:1787388241.424218:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:3644:x1874211971972096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388241.424230:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971972224 00000100:00100000:2.0:1787388241.424232:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971972224 00000100:00100000:2.0:1787388241.424244:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787388241.424250:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971972480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.424263:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:3644:x1874211971972096:12345-0@lo:400:kworker.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388241.424270:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388241.424284:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971972480:12345-0@lo:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388241.424289:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787388241.424299:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787388241.424299:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971972864 00000100:00100000:0.0:1787388241.424302:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971972864 00000100:00100000:2.0:1787388241.424305:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971972224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388241.424355:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874211971972224:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388241.424361:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787388241.425288:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971972352 00000100:00100000:0.0:1787388241.425306:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971972352 00000100:00100000:0.0:1787388241.425495:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388241.425504:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971972864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.425557:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c2710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971972864:12345-0@lo:400:kworker.0 Request processed in 54us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388241.425564:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388241.425579:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388241.425585:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971972352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.425625:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971972352:12345-0@lo:400:kworker.0 Request processed in 40us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388241.425631:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787388241.425704:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9272c2710e00 x1874211971972352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388241.425719:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971972352:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.425734:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971972224:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.425766:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971972096:0@lo:400:kworker.0 00010000:00080000:0.0:1787388241.425777:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9272c2713480 x1874211971972864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388241.425784:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971972864:0@lo:400:kworker.0 00000100:00100000:0.0:1787388241.425793:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971972480:0@lo:400:kworker.0 00000100:00080000:3.0:1787388241.427822:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787388241.427834:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971966208:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787388241.427875:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971972608:0@lo:8:kworker.0 00000400:00000100:3.0:1787388241.427950:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971972608 offset 0 length 520: 4 00000100:00100000:3.0:1787388241.427986:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971972736:0@lo:8:kworker.0 00000400:00000100:3.0:1787388241.428017:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971972736 offset 0 length 520: 4 00000100:00080000:1.0:1787388241.430177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388241.430187:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388241.430190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388241.430193:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787388241.480852:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388242.439915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388242.439935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971972992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388242.440013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388242.440073:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971973120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388242.440098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388242.441396:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971972992 00000100:00100000:1.0:1787388242.441408:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971972992 00000100:00100000:1.0:1787388242.441459:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973120 00000100:00100000:1.0:1787388242.441476:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973120 00000100:00100000:1.0:1787388242.441500:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787388242.441509:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971972992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388242.441549:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787388242.441629:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211971972992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388242.441637:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787388242.441655:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787388242.441662:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971973120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388242.441702:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388242.441732:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971973120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388242.441738:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787388242.441780:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971973120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388242.441796:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971972992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388242.507449:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787388242.887736:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388242.887743:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c2f5e000 from 13 10000000:01000000:2.0:1787388242.887747:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388242.887790:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388242.887813:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388242.887824:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388242.887848:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388242.887918:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388242.888093:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973248 00000100:00100000:0.0:1787388242.888100:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973248 00000100:00100000:0.0:1787388242.888150:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388242.888164:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+16:17143:x1874211971973248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388242.888185:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388242.888197:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812dc3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388242.888218:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388242.888226:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c2c6c000 going to sleep for 11 seconds 00010000:00010000:0.0:1787388242.888229:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388242.888239:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fee00, rc 0) 00000100:00100000:0.0:1787388242.888276:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971973248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388242.888282:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787388242.888354:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388242.888369:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388242.888379:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388242.888435:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.888579:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388242.888611:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fb0c13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388242.888716:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973376 00000100:00100000:0.0:1787388242.888721:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973376 00000100:00100000:0.0:1787388242.888745:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787388242.888750:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971973376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388242.888850:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971973376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388242.888857:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388242.889051:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.889077:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.889113:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388242.889138:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fb0c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388242.889230:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973504 00000100:00100000:2.0:1787388242.889234:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973504 00000100:00100000:2.0:1787388242.889266:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787388242.889272:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d1fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971973504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388242.889418:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d1fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971973504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388242.889424:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388242.889565:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388242.892516:0:18406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787388242.899019:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787388242.899061:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388242.899073:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388242.899086:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388242.899112:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388242.899115:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401a55800 from 13 10000000:01000000:0.0:1787388242.899117:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388242.899155:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388242.899164:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388242.899786:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388242.899816:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388242.899884:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388242.900363:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c53b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787388242.902745:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973632 00000100:00100000:2.0:1787388242.902762:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973632 00000100:00100000:3.0:1787388242.902901:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787388242.902914:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d1fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+17:17143:x1874211971973632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388242.902935:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388242.902955:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812dd1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388242.902994:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388242.903008:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388242.903018:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96400, rc 0) 00000100:00100000:3.0:1787388242.903105:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d1fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971973632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388242.903113:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787388242.903216:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388242.903234:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388242.903244:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388242.903321:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388242.903369:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388242.903404:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c53b6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388242.903511:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973760 00000100:00100000:3.0:1787388242.903515:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973760 00000100:00100000:3.0:1787388242.903547:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388242.903554:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d1fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971973760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.903715:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d1fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971973760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388242.903722:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388242.903748:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.903781:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.903815:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388242.903828:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fb0c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787388242.903838:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971973888 00000100:00100000:3.0:1787388242.903842:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971973888 00000100:00100000:3.0:1787388242.903856:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787388242.903861:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971973888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388242.903927:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:17143:x1874211971973888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388242.903933:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787388242.903963:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971973888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787388242.904706:0:18407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787388242.904764:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787388242.904780:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388242.904790:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388242.904799:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787388242.957077:0:17879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787388243.470841:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388228/real 1787388228] req@ffff9273ffa7c700 x1874211971964288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388243 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388243.470870:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7c700 x1874211971964288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388243 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388243.470892:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388228/real 1787388228] req@ffff9273ffa7e680 x1874211971964416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388243 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388243.470904:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7e680 x1874211971964416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388243 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787388243.470923:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388243.470935:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787388243.470940:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971964288:0@lo:8:kworker.0 00000100:00080000:3.0:1787388243.470945:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388243.470950:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787388243.470953:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971964416:0@lo:8:kworker.0 00000100:00080000:3.0:1787388243.471044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388243.471047:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787388243.471050:0:8:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388243.471054:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1787388243.471060:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787388243.471066:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9272c2371800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388243.471082:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7f800 x1874211971974272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388243.471094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388243.471097:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787388243.471098:0:8:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388243.471101:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1787388243.471103:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787388243.471113:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9273c9716800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:3.0:1787388243.471123:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273ffa7d880 x1874211971974400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388243.471151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388243.471155:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388243.471157:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388243.471161:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388243.471182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971974144:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388243.471266:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787388243.471272:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971974016:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388243.471337:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971974784:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388243.471393:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971974528:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388243.471429:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388243.471434:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971974656:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388243.471478:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971974144 00000100:00100000:3.0:1787388243.471484:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971974144 00000100:00100000:3.0:1787388243.471515:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971974656 00000100:00100000:3.0:1787388243.471518:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971974656 00000100:00100000:3.0:1787388243.471532:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388243.471539:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971974144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471673:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971974144:12345-0@lo:400:kworker.0 Request processed in 132us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388243.471795:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388243.471814:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787388243.471821:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971974656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471854:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971974656:12345-0@lo:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388243.471859:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787388243.471874:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971974016 00000100:00100000:3.0:1787388243.471878:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971974016 00000100:00100000:3.0:1787388243.471898:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787388243.471903:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:3645:x1874211971974016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.471928:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:3645:x1874211971974016:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388243.471934:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787388243.472836:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971974784 00000100:00100000:0.0:1787388243.472843:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971974784 00000100:00100000:0.0:1787388243.472883:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971974528 00000100:00100000:0.0:1787388243.472886:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971974528 00000100:00100000:0.0:1787388243.472900:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388243.472905:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971974784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388243.472948:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971974784:12345-0@lo:400:kworker.0 Request processed in 42us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388243.472954:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388243.472966:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787388243.472972:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971974528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388243.472997:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971974528:12345-0@lo:400:kworker.0 Request processed in 26us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388243.473004:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787388243.475809:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971974656:0@lo:400:kworker.0 00010000:00080000:3.0:1787388243.475830:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273ffa7d180 x1874211971974528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388243.475841:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971974528:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.475882:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971974272:0@lo:8:kworker.0 00000400:00000100:3.0:1787388243.475926:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971974272 offset 0 length 520: 4 00000100:00100000:3.0:1787388243.475958:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971974400:0@lo:8:kworker.0 00000400:00000100:3.0:1787388243.475973:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211971974400 offset 0 length 520: 4 00000100:00100000:3.0:1787388243.476004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971974016:0@lo:400:kworker.0 00010000:00080000:3.0:1787388243.476027:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9273ffa7df80 x1874211971974784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388243.476037:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971974784:0@lo:400:kworker.0 00000100:00100000:3.0:1787388243.476050:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971974144:0@lo:400:kworker.0 00010000:00010000:3.0:1787388243.531589:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388244.425448:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787388244.553911:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388245.576785:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.600158:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787388246.797668:0:18647:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787388246.797672:0:18647:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787388246.797674:0:18647:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787388246.797800:0:18647:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9273fbead800 00000020:01000004:1.0:1787388246.797816:0:18647:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787388246.797830:0:18647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787388246.797845:0:18647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9274019599c0) 00000020:00000080:1.0:1787388246.797861:0:18647:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787388246.869533:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787388246.873193:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787388246.873476:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787388246.874024:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787388246.875611:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787388246.876418:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787388246.876864:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1787388246.878524:0:18647:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787388246.878805:0:18647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787388246.878818:0:18647:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787388246.878829:0:18647:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5cb77467b1812de6 00000020:01000004:3.0:1787388246.878835:0:18647:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787388246.878860:0:18647:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787388246.878863:0:18647:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787388246.878867:0:18647:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787388246.878872:0:18647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787388246.878882:0:18647:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9273d0f44d40) 00000020:00000080:3.0:1787388246.878893:0:18647:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787388246.880068:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388246.880225:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787388246.880231:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787388246.882979:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787388246.882990:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787388246.883515:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787388246.883523:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787388246.885562:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388246.886460:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787388246.886467:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787388246.895932:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787388246.895986:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787388246.926418:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388246.926769:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787388246.926789:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787388246.928534:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787388246.928546:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787388246.929947:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787388246.929960:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787388246.935551:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388246.936034:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787388246.936049:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787388246.937305:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787388246.937316:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787388246.982449:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787388246.982655:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787388246.982662:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787388246.984950:0:18647:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787388246.984962:0:18647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787388246.985448:0:18647:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787388246.985476:0:18647:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787388246.985482:0:18647:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787388247.003996:0:18647:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787388247.004053:0:18647:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.152@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787388247.004058:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787388247.004060:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787388247.004061:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787388247.004062:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787388247.004063:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787388247.004065:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787388247.004067:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787388247.004068:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787388247.004070:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787388247.004074:0:18647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787388247.004077:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787388247.004078:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787388247.004079:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787388247.004080:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787388247.004081:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787388247.004083:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787388247.004083:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787388247.004085:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787388247.004085:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787388247.004186:0:18647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787388247.004207:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971974912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787388247.004272:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388247.004354:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ca15a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.007833:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971974912 00000100:00100000:2.0:1787388247.007849:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971974912 00000100:00100000:2.0:1787388247.007951:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787388247.007962:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:18647:x1874211971974912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787388247.008001:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787388247.008005:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787388247.008009:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787388247.009880:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:18647:x1874211971974912:12345-0@lo:253:mount.lustre.0 Request processed in 1912us (5599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.009894:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787388247.010036:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971974912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787388247.010069:0:18647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787388247.010072:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787388247.010074:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388247.010075:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388247.010076:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388247.010077:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388247.010078:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388247.010080:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388247.010082:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388247.010084:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787388247.010227:0:18647:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9273fbead800 from lustre-OST0000 10000000:01000000:1.0:1787388247.010256:0:18647:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787388247.010259:0:18647:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787388247.010268:0:18647:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9273ff9419c0 local copy 00010000:00010000:1.0:1787388247.010278:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388247.010425:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.010464:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.010508:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388247.010754:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975040 00000100:00100000:0.0:1787388247.010760:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975040 00000100:00100000:0.0:1787388247.010835:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787388247.010845:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:18647:x1874211971975040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388247.010928:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:18647:x1874211971975040:12345-0@lo:501:mount.lustre.0 Request processed in 84us (462us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388247.010934:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787388247.011292:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975040:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787388247.011307:0:18647:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787388247.011327:0:18647:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787388247.011333:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.011350:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388247.011380:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9273fbead800 10000000:01000000:1.0:1787388247.011386:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787388247.011391:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787388247.011393:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388247.011398:0:18647:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787388247.011400:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787388247.011423:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.011431:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.011439:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388247.011454:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388247.011483:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.011515:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388247.011597:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975168 00000100:00100000:0.0:1787388247.011602:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975168 00000100:00100000:0.0:1787388247.011635:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787388247.011642:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+18:18647:x1874211971975168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388247.011650:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388247.011664:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ff600/0x5cb77467b1812dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812df4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388247.011730:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ff600/0x5cb77467b1812dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812df4 expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388247.011741:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ff600/0x5cb77467b1812dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812df4 expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388247.011750:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff600, rc 0) 00000100:00100000:0.0:1787388247.011781:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975168:12345-0@lo:101:mount.lustre.0 Request processed in 139us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.011788:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787388247.012462:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388247.012479:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dfb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.012489:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812dfb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388247.013888:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787388247.014833:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388247.016515:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787388247.016557:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787388247.016568:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787388247.016600:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787388247.016614:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787388247.016624:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787388247.016643:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787388247.016648:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787388247.016778:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.016837:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.016869:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.017029:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975296 00000100:00100000:2.0:1787388247.017036:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975296 00000100:00100000:2.0:1787388247.017083:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787388247.017099:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388247.017223:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975296:12345-0@lo:501:mount.lustre.0 Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.017230:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787388247.017470:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.017499:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388247.017536:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.017596:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.017921:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975424 00000100:00100000:3.0:1787388247.017926:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975424 00000100:00100000:3.0:1787388247.017995:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787388247.018005:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388247.018900:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975424:12345-0@lo:503:mount.lustre.0 Request processed in 894us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.018910:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787388247.019066:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975424:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388247.019441:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388247.019507:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388247.019548:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.019954:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.020024:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975552 00000100:00100000:2.0:1787388247.020030:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975552 00000100:00100000:2.0:1787388247.020068:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787388247.020076:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388247.020516:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975552:12345-0@lo:502:mount.lustre.0 Request processed in 439us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.020523:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388247.020619:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388247.020804:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787388247.020830:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787388247.020848:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787388247.020858:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787388247.020884:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787388247.020898:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787388247.020910:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787388247.020920:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787388247.020930:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787388247.020940:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787388247.020951:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787388247.020961:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787388247.020984:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388247.021019:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.021038:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.021237:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975680 00000100:00100000:2.0:1787388247.021246:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975680 00000100:00100000:2.0:1787388247.021266:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787388247.021273:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388247.021342:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975680:12345-0@lo:502:mount.lustre.0 Request processed in 68us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.021348:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787388247.021417:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388247.021451:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787388247.021458:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787388247.023904:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787388247.023917:0:18664:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787388247.023923:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.023925:0:18664:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787388247.023932:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388247.023947:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9273fb1599c0) 00000020:00000080:2.0:1787388247.023974:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787388247.023980:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787388247.024205:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273fbead800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787388247.024216:0:18664:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787388247.024225:0:18664:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5cb77467b1812e09 00010000:00010000:1.0:1787388247.029540:0:18664:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787388247.030347:0:18664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1787388247.031954:0:18664:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787388247.033373:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787388247.033384:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388247.033390:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388247.033392:0:18664:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787388247.033395:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787388247.033398:0:18664:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787388247.033399:0:18664:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388247.033401:0:18664:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388247.033402:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787388247.033404:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388247.033406:0:18664:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787388247.033408:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388247.033417:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388247.033418:0:18664:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787388247.033422:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787388247.033424:0:18664:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787388247.033426:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388247.033428:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388247.033429:0:18664:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787388247.033432:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388247.033434:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388247.033435:0:18664:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787388247.033438:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787388247.033460:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388247.033463:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388247.033464:0:18664:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787388247.033467:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787388247.038977:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787388247.039022:0:18647:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787388247.039036:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dfb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039048:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1021400/0x5cb77467b1812df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812dfb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388247.039067:0:18647:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273fbead800 from 1 10000000:01000000:2.0:1787388247.039070:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388247.039118:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039127:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039146:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388247.039172:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388247.039239:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388247.039279:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975808 00000100:00100000:2.0:1787388247.039285:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975808 00000100:00100000:2.0:1787388247.039323:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388247.039332:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:18647:x1874211971975808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388247.039344:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388247.039356:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812e10 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039377:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039388:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039397:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708000, rc 0) 00000100:00100000:2.0:1787388247.039432:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971975808:12345-0@lo:101:mount.lustre.0 Request processed in 102us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.039439:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388247.039479:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273f5e1a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.039501:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388247.039513:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.039527:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388247.041256:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787388247.041487:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388247.041732:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787388247.041754:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787388247.041769:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787388247.041773:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787388247.041831:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.041886:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.041990:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ca355840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.046844:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971975936 00000100:00100000:3.0:1787388247.046860:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971975936 00000100:00100000:3.0:1787388247.046967:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787388247.046978:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971975936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388247.047179:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971975936:12345-0@lo:501:mount.lustre.0 Request processed in 203us (5292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.047187:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787388247.047271:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971975936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.047321:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388247.047376:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.047932:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388247.048032:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976064 00000100:00100000:0.0:1787388247.048038:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976064 00000100:00100000:0.0:1787388247.048179:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787388247.048189:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388247.048301:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976064:12345-0@lo:503:mount.lustre.0 Request processed in 114us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.048309:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787388247.048394:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976064:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388247.048837:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388247.048918:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388247.048962:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.048988:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388247.049219:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976192 00000100:00100000:0.0:1787388247.049224:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976192 00000100:00100000:0.0:1787388247.049246:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388247.049252:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388247.049342:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976192:12345-0@lo:502:mount.lustre.0 Request processed in 89us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.049350:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787388247.049487:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388247.049670:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787388247.049717:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787388247.049733:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787388247.049747:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787388247.049762:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787388247.049790:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787388247.049806:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787388247.049820:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787388247.049832:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787388247.049843:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787388247.049856:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787388247.049877:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388247.049913:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.049934:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c10ff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.050032:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976320 00000100:00100000:3.0:1787388247.050037:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976320 00000100:00100000:3.0:1787388247.050074:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787388247.050082:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388247.050174:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976320:12345-0@lo:502:mount.lustre.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.050181:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787388247.050336:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388247.050374:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787388247.050381:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787388247.051313:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388247.051325:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051328:0:18668:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787388247.051335:0:18668:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273fbead800 00000020:00000080:2.0:1787388247.051338:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388247.051346:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388247.051349:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051350:0:18668:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787388247.051353:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388247.051355:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051356:0:18668:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787388247.051359:0:18668:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9273fbead800 00000020:00000080:2.0:1787388247.051362:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388247.051425:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388247.051429:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051430:0:18668:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787388247.051433:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388247.051436:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051437:0:18668:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388247.051440:0:18668:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273fbead800 00000020:00000080:2.0:1787388247.051443:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388247.051461:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388247.051465:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051466:0:18668:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388247.051468:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388247.051471:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051472:0:18668:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787388247.051476:0:18668:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9273fbead800 00000020:00000080:2.0:1787388247.051485:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388247.051512:0:18668:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388247.051516:0:18668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388247.051517:0:18668:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388247.051521:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787388247.053370:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787388247.053413:0:18647:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388247.053439:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.053452:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388247.053514:0:18647:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787388247.053517:0:18647:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9273fbead800 10000000:01000000:3.0:1787388247.053520:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9273fbead800 10000000:01000000:3.0:1787388247.053524:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787388247.053530:0:18647:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9273fbead800 from 1 10000000:01000000:3.0:1787388247.053533:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787388247.053597:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.053613:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.053625:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388247.053651:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787388247.053764:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388247.053805:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976448 00000100:00100000:3.0:1787388247.053812:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976448 00000100:00100000:3.0:1787388247.053863:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787388247.053873:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:18647:x1874211971976448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388247.053891:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388247.053906:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef97600/0x5cb77467b1812e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812e1e expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.053934:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef97600/0x5cb77467b1812e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812e1e expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.053945:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef97600/0x5cb77467b1812e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e1e expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.053954:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97600, rc 0) 00000100:00100000:3.0:1787388247.053990:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976448:12345-0@lo:101:mount.lustre.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.053998:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787388247.054045:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0fd3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.054282:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388247.054295:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e25 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.054305:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812e25 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787388247.062659:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787388247.063170:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787388247.063399:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787388247.063425:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787388247.063442:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787388247.063455:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787388247.063467:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787388247.063480:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787388247.063507:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787388247.063522:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787388247.063535:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787388247.063548:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787388247.063561:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787388247.063572:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787388247.063585:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787388247.063614:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787388247.063628:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787388247.063642:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787388247.063658:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787388247.063669:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787388247.063709:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787388247.063726:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787388247.063741:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787388247.063755:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787388247.063780:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787388247.063794:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787388247.063807:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787388247.063819:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787388247.063831:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787388247.063842:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787388247.063852:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787388247.063861:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787388247.063871:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787388247.071306:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787388247.071337:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787388247.071349:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787388247.071362:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787388247.071375:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787388247.071389:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787388247.071414:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787388247.071418:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787388247.071545:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.072287:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.072333:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388247.072614:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976576 00000100:00100000:0.0:1787388247.072622:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976576 00000100:00100000:0.0:1787388247.072700:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787388247.072710:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388247.072894:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976576:12345-0@lo:501:mount.lustre.0 Request processed in 184us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388247.072903:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787388247.073321:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388247.073364:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388247.073410:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388247.073442:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273cba1fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.075244:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976704 00000100:00100000:3.0:1787388247.075256:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976704 00000100:00100000:3.0:1787388247.075302:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787388247.075310:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388247.076331:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388247.076670:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976704:12345-0@lo:503:mount.lustre.0 Request processed in 1359us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.076699:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000040:00080000:0.0:1787388247.079048:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787388247.079161:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388247.079233:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388247.079273:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c3219180 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.079441:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976832 00000100:00100000:3.0:1787388247.079447:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976832 00000100:00100000:3.0:1787388247.079489:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787388247.079497:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388247.080932:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976832:12345-0@lo:502:mount.lustre.0 Request processed in 1429us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.080944:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787388247.081826:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388247.082071:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787388247.082105:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787388247.082120:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787388247.082133:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787388247.082146:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787388247.082157:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787388247.082170:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787388247.082184:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787388247.082197:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787388247.082209:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787388247.082221:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787388247.082233:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787388247.082245:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787388247.082257:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787388247.082269:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787388247.082303:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787388247.082318:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787388247.082330:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787388247.082342:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787388247.082352:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787388247.082364:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787388247.082377:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787388247.082389:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787388247.082402:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787388247.082414:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787388247.082427:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787388247.082439:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787388247.082451:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787388247.082463:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787388247.082476:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787388247.082489:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787388247.082518:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787388247.082533:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787388247.082545:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787388247.082556:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787388247.082566:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787388247.082578:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787388247.082607:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787388247.082621:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787388247.082634:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787388247.082647:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787388247.082660:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787388247.082671:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787388247.082718:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787388247.082735:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787388247.082748:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787388247.082760:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787388247.082788:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787388247.082844:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388247.082908:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388247.082946:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c3219180 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.083708:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971976960 00000100:00100000:3.0:1787388247.083717:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971976960 00000100:00100000:3.0:1787388247.083779:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787388247.083787:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388247.085709:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971976960:12345-0@lo:502:mount.lustre.0 Request processed in 1914us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.085727:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971976960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388247.085732:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000040:00080000:0.0:1787388247.087056:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787388247.087103:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787388247.087145:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971977088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388247.087209:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388247.087695:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c3219180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.093137:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977088 00000100:00100000:2.0:1787388247.093150:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977088 00000100:00100000:2.0:1787388247.093210:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388247.093220:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971977088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388247.093439:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971977088:12345-0@lo:502:mount.lustre.0 Request processed in 219us (6229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.093448:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787388247.093556:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971977088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388247.093652:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787388247.093667:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787388247.097352:0:18674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787388247.097368:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9273fb15b380) 00000020:00000080:2.0:1787388247.097393:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787388247.097543:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273fbead800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787388247.097547:0:18674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273fbead800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787388247.097549:0:18674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273fbead800 3 00010000:00080000:2.0:1787388247.097581:0:18674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c207a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.152@tcp at head 00010000:00010000:2.0:1787388247.100399:0:18674:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787388247.100502:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787388247.100547:0:18674:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787388247.100562:0:18674:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5cb77467b1812e33 00000100:00080000:2.0:1787388247.100573:0:18674:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388247.100578:0:18674:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9272c207a000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787388247.103092:0:18674:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3cb8700 x1874211971977216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388247.103161:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971977216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787388247.103238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787388247.103296:0:18674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787388247.103340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.103351:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388247.103354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.103357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388247.103382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.103384:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388247.103387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.103389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787388247.103460:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977216 00000100:00100000:0.0:1787388247.103468:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977216 00000100:00100000:0.0:1787388247.103503:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388247.103511:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971977216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787388247.103535:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1787388247.103582:0:17146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5cb77467b1812e3a 00000004:00100000:0.0:1787388247.103608:0:17146:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787388247.103641:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9272c2cb8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388247.103781:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971977472:0@lo:400:kworker.0 00000100:00100000:2.0:1787388247.103810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388247.103831:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388247.103837:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971977600:0@lo:400:kworker.0 00000100:00100000:2.0:1787388247.103874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388247.103913:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971977344:0@lo:400:kworker.0 00000100:00100000:2.0:1787388247.103936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388247.103953:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388247.103959:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971977728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388247.103980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388247.104066:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874211971977216:12345-0@lo:38:llog_process_th.0 Request processed in 554us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.104074:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388247.104089:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977472 00000100:00100000:0.0:1787388247.104093:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977472 00000100:00100000:0.0:1787388247.104111:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977728 00000100:00100000:0.0:1787388247.104122:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977728 00000100:00100000:0.0:1787388247.104140:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787388247.104146:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971977472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388247.104193:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971977472:12345-0@lo:400:kworker.0 Request processed in 46us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.104199:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787388247.104211:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787388247.104218:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971977728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388247.104250:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971977728:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.104257:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388247.104262:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977600 00000100:00100000:1.0:1787388247.104267:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977600 00000100:00100000:1.0:1787388247.104286:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977344 00000100:00100000:1.0:1787388247.104289:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977344 00000100:00100000:1.0:1787388247.104302:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388247.104308:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971977600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388247.104342:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971977600:12345-0@lo:400:kworker.0 Request processed in 34us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388247.104349:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388247.104362:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787388247.104367:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971977344:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787388247.104381:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9272c3cbad80 x1874211971977728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388247.104394:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971977728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388247.104458:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971977600:0@lo:400:kworker.0 00010000:00080000:2.0:1787388247.104470:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9272c3cb9880 x1874211971977472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388247.104479:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971977472:0@lo:400:kworker.0 00010000:00080000:3.0:1787388247.104527:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9272c3cb8700 x1874211971977216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388247.104535:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388247.104541:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787388247.104548:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787388247.104554:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787388247.104556:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c207a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787388247.104563:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874211971977216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787388247.104675:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971977344:12345-0@lo:400:kworker.0 Request processed in 306us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388247.104996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971977344:0@lo:400:kworker.0 00000100:00100000:1.0:1787388247.105383:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:01000004:2.0:1787388247.105617:0:18674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787388247.105640:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9273fb158000) 00000020:00000080:2.0:1787388247.105662:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787388247.106056:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9273fbead800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787388247.106060:0:18674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9273fbead800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787388247.106062:0:18674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9273fbead800 3 00010000:00080000:2.0:1787388247.106090:0:18674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c207b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.152@tcp at head 00010000:00010000:2.0:1787388247.107952:0:18674:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787388247.108087:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787388247.108136:0:18674:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787388247.108151:0:18674:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5cb77467b1812e48 00000100:00080000:2.0:1787388247.108162:0:18674:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388247.108168:0:18674:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9272c207b000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787388247.108206:0:18674:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c34bc000 x1874211971977856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388247.108242:0:18674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787388247.108281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.108286:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388247.108290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.108292:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388247.108296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.108300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388247.108302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388247.108305:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388247.110204:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874211971977856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787388247.110281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388247.110389:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977856 00000100:00100000:3.0:1787388247.110397:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977856 00000100:00100000:3.0:1787388247.110473:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388247.110480:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971977856:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787388247.110508:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1787388247.110547:0:17146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5cb77467b1812e4f 00000004:00100000:3.0:1787388247.110563:0:17146:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787388247.110604:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9272c20d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388247.110659:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874211971977856:12345-0@lo:38:llog_process_th.0 Request processed in 178us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.110667:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787388247.112840:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9272c34bc000 x1874211971977856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388247.112866:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388247.112886:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787388247.112896:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787388247.112901:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787388247.112905:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c207b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787388247.112911:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874211971977856:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787388247.116310:0:18674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787388247.116480:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787388247.116511:0:18647:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787388247.116532:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e25 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.116556:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273eef97800/0x5cb77467b1812e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e25 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787388247.116613:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787388247.116615:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388247.116616:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388247.116617:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388247.116618:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388247.116619:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388247.116621:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388247.116623:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388247.116624:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787388247.116628:0:18647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787388247.116631:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388247.116632:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388247.116633:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388247.116634:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388247.116635:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388247.116636:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388247.116637:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388247.116638:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388247.116640:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787388247.116663:0:18647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787388247.117083:0:18647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971977984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388247.117148:0:18647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.117214:0:18647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388247.117316:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971977984 00000100:00100000:3.0:1787388247.117323:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971977984 00000100:00100000:3.0:1787388247.117365:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787388247.117379:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971977984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787388247.117404:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787388247.117415:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787388247.126659:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787388247.126673:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787388247.126848:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787388247.126853:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787388247.126889:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.126909:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.126936:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.126943:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.126981:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.126995:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388247.127011:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971978112:0@lo:104: 00000100:00100000:1.0:1787388247.127074:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787388247.127125:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388247.127134:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 21 pid: 17141 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388247.127143:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971978240:0@lo:104: 00000100:00100000:1.0:1787388247.127165:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388247.127187:0:17162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0d5d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388247.127261:0:17130:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787388247.127275:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978112 00000100:00100000:2.0:1787388247.127281:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978112 00000100:00100000:2.0:1787388247.127316:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978240 00000100:00100000:2.0:1787388247.127319:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978240 00000100:00100000:2.0:1787388247.127334:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787388247.127342:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:18647:x1874211971977984:12345-0@lo:253:mount.lustre.0 Request processed in 9964us (10194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.127342:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:17162:x1874211971978112:12345-0@lo:104: 00000100:00100000:3.0:1787388247.127352:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1787388247.127353:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388247.127422:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971978112:0@lo:104: 00000100:00100000:1.0:1787388247.129084:0:18647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:18647:1874211971977984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787388247.129100:0:18647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787388247.129103:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787388247.129105:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388247.129106:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388247.129122:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388247.129123:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388247.129124:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388247.129126:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388247.129128:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388247.129129:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787388247.129147:0:18647:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787388247.130121:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388247.130132:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:17162:x1874211971978112:12345-0@lo:104: Request processed in 2788us (3055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.130142:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388247.130173:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388247.130183:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971978240:12345-0@lo:104: 00010000:00010000:2.0:1787388247.130197:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388247.130315:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cabb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971978240:0@lo:104: 00010000:00010000:1.0:1787388247.130338:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.130658:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388247.130666:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.130675:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef97c00 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:3.0:1787388247.130835:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.130844:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388247.130851:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388247.130857:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787388247.130935:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.130943:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388247.130975:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.130993:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273eef97c00/0x5cb77467b1812da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.131005:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388247.131008:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.131014:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff800 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:3.0:1787388247.131017:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.131024:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388247.131030:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388247.131035:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1787388247.131143:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971978368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388247.131188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388247.131410:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787388247.131424:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971978240:12345-0@lo:104: Request processed in 1244us (4257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.131432:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388247.131479:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978368 00000100:00100000:2.0:1787388247.131486:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978368 00010000:00010000:2.0:1787388247.131506:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388247.131530:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388247.131535:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:3645:x1874211971978368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388247.131545:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388247.131549:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.131561:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.131575:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23ff000/0x5cb77467b1812dae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812da7 expref: 21 pid: 17138 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388247.131599:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388247.131634:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:3645:x1874211971978368:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388247.131641:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388247.131710:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971978368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388247.132022:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787388247.132229:0:18647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787388247.132810:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.132821:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388247.132846:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.132854:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812da0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.132870:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388247.132970:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388247.132973:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388247.132987:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388247.133001:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971978496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388247.133119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388247.133349:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978496 00000100:00100000:3.0:1787388247.133356:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978496 00010000:00010000:3.0:1787388247.133381:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 20 pid: 17141 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388247.133471:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787388247.133479:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:3647:x1874211971978496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388247.133489:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388247.133495:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 20 pid: 17141 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133506:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 20 pid: 17141 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133519:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c0031600/0x5cb77467b1812da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812d99 expref: 20 pid: 17141 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133534:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133542:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787388247.133556:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006703541s 00010000:00010000:3.0:1787388247.133561:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133709:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133717:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133724:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133729:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388247.133733:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133741:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133756:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133766:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388247.133799:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:3647:x1874211971978496:12345-0@lo:103:ldlm_bl.0 Request processed in 321us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.133806:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787388247.133861:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971978496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388247.133879:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133887:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388247.133903:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273d1020e00/0x5cb77467b1812e56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787388247.137497:0:18647:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787388247.137507:0:18647:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787388247.137543:0:18647:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787388247.137600:0:18647:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787388247.137619:0:18647:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787388247.137653:0:18647:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787388247.142193:0:18647:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388247.142436:0:18647:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787388247.563761:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388247.563790:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971978624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388247.563863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388247.565213:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978624 00000100:00100000:3.0:1787388247.565222:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978624 00000100:00100000:0.0:1787388247.565281:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971978752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388247.565341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388247.569077:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978752 00000100:00100000:3.0:1787388247.569091:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978752 00000100:00100000:3.0:1787388247.569128:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388247.569137:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971978624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388247.569177:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787388247.569265:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971978624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (5401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.569272:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388247.569313:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787388247.569321:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971978752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388247.569338:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388247.569375:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971978752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388247.569381:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787388247.569460:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971978752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388247.569611:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971978624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388247.627281:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388247.936161:0:18727:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388247.937169:0:18727:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787388248.263810:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787388248.263817:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c2f5e000 from 9 10000000:01000000:0.0:1787388248.263822:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787388248.263879:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388248.263910:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388248.263921:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388248.263949:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971978880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388248.264022:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388248.264088:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c3219180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388248.264221:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971978880 00000100:00100000:2.0:1787388248.264228:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971978880 00000100:00100000:2.0:1787388248.264281:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787388248.264301:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+19:17143:x1874211971978880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388248.264315:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388248.264329:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812e5d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388248.264350:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388248.264359:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388248.264369:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708a00, rc 0) 00000100:00100000:2.0:1787388248.264422:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:17143:x1874211971978880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388248.264430:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787388248.264749:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971978880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388248.264765:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388248.264773:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388248.264828:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971979008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388248.264863:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388248.264895:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef58480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388248.264960:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979008 00000100:00100000:3.0:1787388248.264965:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979008 00000100:00100000:3.0:1787388248.264992:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787388248.265000:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:17143:x1874211971979008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388248.265025:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388248.265044:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388248.265047:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787388248.265144:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:17143:x1874211971979008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388248.265151:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787388248.265281:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971979008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388248.265350:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388248.265357:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388248.265367:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388248.265377:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787388248.265380:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff927401a55800 from 9 10000000:01000000:1.0:1787388248.265383:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787388248.265402:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388248.265409:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388248.265416:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388248.265430:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971979136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388248.265458:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388248.265481:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef58480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388248.265580:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979136 00000100:00100000:3.0:1787388248.265584:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979136 00000100:00100000:3.0:1787388248.265603:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787388248.265610:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:17143:x1874211971979136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388248.265617:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388248.265627:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812e6b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388248.265642:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388248.265651:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388248.265658:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97c00, rc 0) 00000100:00100000:3.0:1787388248.265728:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971979136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388248.265733:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787388248.266162:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971979136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388248.266175:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388248.266184:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388248.266240:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971979264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388248.266273:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388248.266360:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef58480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388248.266409:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979264 00000100:00100000:3.0:1787388248.266413:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979264 00000100:00100000:3.0:1787388248.266485:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787388248.266492:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971979264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388248.266515:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388248.266528:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388248.266531:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787388248.266619:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971979264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388248.266627:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787388248.266716:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971979264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388248.266763:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388248.266770:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388248.266778:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388248.649833:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388249.675366:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388250.700842:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388251.018543:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388251.720880:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787388252.167850:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388252.167857:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388252.167861:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388252.167864:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388252.167891:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1787388252.167892:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971979392:0@lo:400:kworker.0 00000100:00080000:2.0:1787388252.167896:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388252.167903:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388252.167918:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787388252.167975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971979520:0@lo:400:kworker.0 00000100:00100000:3.0:1787388252.167976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388252.170142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388252.170210:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971980032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388252.170291:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787388252.170298:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971979648:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170322:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388252.170340:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971980160:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388252.170419:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980032 00000100:00100000:2.0:1787388252.170428:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980032 00000100:00100000:2.0:1787388252.170471:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979648 00000100:00100000:2.0:1787388252.170474:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979648 00000100:00100000:2.0:1787388252.170495:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980160 00000100:00100000:2.0:1787388252.170497:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980160 00000100:00100000:2.0:1787388252.170515:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388252.170523:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971980032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170578:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971980032:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388252.170585:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388252.170602:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388252.170607:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971979648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170636:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971979648:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388252.170641:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388252.170663:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787388252.170669:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971980160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170720:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971980160:12345-0@lo:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388252.170726:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787388252.170765:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bca80 x1874211971979648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388252.170780:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971979648:0@lo:400:kworker.0 00010000:00080000:2.0:1787388252.170790:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bdf80 x1874211971980160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388252.170797:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971980160:0@lo:400:kworker.0 00010000:00080000:2.0:1787388252.170806:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bc380 x1874211971980032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388252.170813:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971980032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170858:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971979776:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170886:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388252.170915:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971979904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.170927:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979520 00000100:00100000:2.0:1787388252.170932:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979520 00000100:00100000:3.0:1787388252.170952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388252.171210:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388252.171215:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388252.171783:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979776 00000100:00100000:2.0:1787388252.171789:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979776 00000100:00100000:2.0:1787388252.171810:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388252.171817:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971979520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.171882:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971979520:12345-0@lo:400:kworker.0 Request processed in 65us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388252.171889:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388252.171913:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388252.171919:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971979776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.172098:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971979776:12345-0@lo:400:kworker.0 Request processed in 178us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388252.172106:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388252.172158:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971979776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388252.172245:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971979520:0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.172293:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979392 00000100:00100000:2.0:1787388252.172297:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979392 00000100:00100000:2.0:1787388252.172333:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787388252.172341:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:3645:x1874211971979392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388252.172513:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971979904 00000100:00100000:3.0:1787388252.172518:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971979904 00000100:00100000:3.0:1787388252.172551:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787388252.172559:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971979904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388252.172563:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:3645:x1874211971979392:12345-0@lo:400:kworker.0 Request processed in 221us (4586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388252.172572:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787388252.172604:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971979904:12345-0@lo:400:kworker.0 Request processed in 45us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388252.172613:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787388252.173175:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971979392:0@lo:400:kworker.0 00010000:00080000:1.0:1787388252.173204:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bd880 x1874211971979904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388252.173216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971979904:0@lo:400:kworker.0 00000100:00100000:3.0:1787388252.679793:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388252.679816:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971980288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388252.679889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388252.679934:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980288 00000100:00100000:3.0:1787388252.679942:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980288 00000100:00100000:3.0:1787388252.679987:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388252.679996:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971980288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388252.680030:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388252.680080:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971980288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388252.680087:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388252.680135:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971980288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388252.684782:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388252.684803:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971980416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388252.684868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388252.684921:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980416 00000100:00100000:0.0:1787388252.684929:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980416 00000100:00100000:0.0:1787388252.684973:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787388252.684982:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971980416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388252.685014:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388252.685056:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971980416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388252.685063:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787388252.685105:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971980416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388252.744213:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388252.749574:0:19017:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1787388253.518078:0:19069:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388253.518330:0:19069:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787388253.773787:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388254.309123:0:19119:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388254.309350:0:19119:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1787388254.668208:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787388254.792771:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388255.816473:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388256.328039:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388241/real 1787388241] req@ffff9272c2711f80 x1874211971972608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388256.328066:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c2711f80 x1874211971972608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388256.328075:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388241/real 1787388241] req@ffff9272c2713b80 x1874211971972736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388256.328086:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9272c2713b80 x1874211971972736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388256.328105:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eeed4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388256.328127:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388256.328131:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971972608:0@lo:8:kworker.0 00000100:00080000:2.0:1787388256.328144:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388256.328149:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388256.328151:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c2713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971972736:0@lo:8:kworker.0 00000100:00080000:1.0:1787388256.328357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388256.328362:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388256.328364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388256.328367:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388256.328394:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388256.328397:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787388256.328400:0:36:0:(import.c:65:import_set_state_nolock()) ffff9273eeed4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388256.328418:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1787388256.328423:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787388256.328430:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9273eeed4800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388256.328455:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3ca8380 x1874211971981056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388256.328469:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388256.328472:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787388256.328474:0:36:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388256.328478:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1787388256.328480:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787388256.328484:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9273eecb0000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388256.328496:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3cab480 x1874211971981184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388256.328535:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971980672:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.328654:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971981440:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.328744:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787388256.328751:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971980544:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.328800:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971981312:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.328843:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971980800:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.328893:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971981568:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.328935:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388256.328943:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971980928:0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.328964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.329000:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980672 00000100:00100000:1.0:1787388256.329007:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980672 00000100:00100000:1.0:1787388256.329045:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980928 00000100:00100000:1.0:1787388256.329048:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980928 00000100:00100000:1.0:1787388256.329064:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787388256.329073:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971980672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329122:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971980672:12345-0@lo:400:kworker.0 Request processed in 50us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329130:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787388256.329148:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787388256.329155:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971980928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329192:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971980928:12345-0@lo:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329208:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787388256.329238:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981440 00000100:00100000:1.0:1787388256.329242:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981440 00000100:00100000:1.0:1787388256.329270:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981312 00000100:00100000:1.0:1787388256.329273:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981312 00000100:00100000:1.0:1787388256.329283:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980800 00000100:00100000:1.0:1787388256.329285:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980800 00000100:00100000:1.0:1787388256.329299:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981568 00000100:00100000:1.0:1787388256.329301:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981568 00000100:00100000:1.0:1787388256.329323:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388256.329330:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971981440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329370:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874211971981440:12345-0@lo:400:kworker.0 Request processed in 41us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329376:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388256.329398:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388256.329419:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971981312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329463:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971981312:12345-0@lo:400:kworker.0 Request processed in 59us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329469:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388256.329480:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388256.329487:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971980800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329509:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971980800:12345-0@lo:400:kworker.0 Request processed in 24us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329515:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388256.329526:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388256.329532:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971981568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329566:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971981568:12345-0@lo:400:kworker.0 Request processed in 35us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329573:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388256.329592:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971980544 00000100:00100000:1.0:1787388256.329595:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971980544 00000100:00100000:1.0:1787388256.329619:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787388256.329626:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:3647:x1874211971980544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388256.329657:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:3647:x1874211971980544:12345-0@lo:400:kworker.0 Request processed in 31us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.329663:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787388256.329716:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388256.329719:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388256.329734:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971981056:0@lo:8:kworker.0 00000100:00100000:1.0:1787388256.329762:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.329783:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971981184:0@lo:8:kworker.0 00000100:00100000:1.0:1787388256.329801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.329832:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981056 00000100:00100000:1.0:1787388256.329835:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981056 00000100:00100000:1.0:1787388256.329848:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981184 00000100:00100000:1.0:1787388256.329851:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981184 00000100:00100000:1.0:1787388256.329859:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787388256.329864:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971981056:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787388256.329885:0:18651:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1787388256.329911:0:18651:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812e79 00002000:00100000:1.0:1787388256.329923:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9273eedc5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787388256.329927:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787388256.329936:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787388256.330096:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787388256.330118:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9273eedc5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388256.330157:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874211971981056:12345-0@lo:8:kworker.0 Request processed in 291us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.330164:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787388256.330180:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388256.330185:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971981184:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787388256.330199:0:18651:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787388256.338823:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971980928:0@lo:400:kworker.0 00010000:00080000:0.0:1787388256.338858:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c3ca9c00 x1874211971980800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388256.338870:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971980800:0@lo:400:kworker.0 00010000:00080000:0.0:1787388256.338888:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c3ca9880 x1874211971981568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388256.338897:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971981568:0@lo:400:kworker.0 00000100:00100000:0.0:1787388256.338939:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971980544:0@lo:400:kworker.0 00010000:00080000:0.0:1787388256.338951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c3caaa00 x1874211971981312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388256.338960:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971981312:0@lo:400:kworker.0 00000100:00100000:0.0:1787388256.338973:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971980672:0@lo:400:kworker.0 00010000:00080000:0.0:1787388256.338986:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c3cab100 x1874211971981440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388256.338994:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874211971981440:0@lo:400:kworker.0 00010000:00080000:0.0:1787388256.343798:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c3ca8380 x1874211971981056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388256.343815:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388256.343826:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787388256.343836:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787388256.343843:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787388256.343846:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eeed4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787388256.343869:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787388256.343884:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971981056:0@lo:8:kworker.0 00000004:00080000:0.0:1787388256.343958:0:17888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787388256.343982:0:17888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1874211971981824:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787388256.344043:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388256.344243:0:17888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eef59f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388256.344256:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388256.344268:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971981696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388256.344296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787388256.344385:0:17887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787388256.344495:0:17887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 545328815179ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787388256.344502:0:17887:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787388256.344546:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787388256.344554:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787388256.344578:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981696 00000100:00100000:3.0:1787388256.345427:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981696 00000100:00100000:3.0:1787388256.345498:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787388256.345507:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971981696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388256.345534:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388256.345611:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971981696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388256.345619:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787388256.345751:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c4469880 x1874211971981696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388256.345772:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971981696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388256.345820:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981824 00000100:00100000:3.0:1787388256.345824:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981824 00000100:00080000:0.0:1787388256.347386:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388256.347746:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388256.347760:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1874211971981824:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787388256.353470:0:17879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787388256.360060:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971981184:12345-0@lo:8:kworker.0 Request processed in 29864us (30248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388256.360076:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787388256.360375:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388256.360384:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787388256.360388:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971981184:0@lo:8:kworker.0 00002000:00080000:0.0:1787388256.370147:0:19203:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787388256.370158:0:19203:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787388256.370295:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1874211971981824:12345-0@lo:7:osp-pre-0-1.0 Request processed in 22536us (26248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388256.370310:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787388256.370383:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c4468a80 x1874211971981824/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787388272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388256.370399:0:17888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1874211971981824:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787388256.370422:0:17888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787388256.370461:0:17888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1874211971981952:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787388256.370493:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388256.370525:0:17888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e7643c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388256.370573:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971981952 00000100:00100000:2.0:1787388256.370580:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971981952 00000100:00100000:2.0:1787388256.370897:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787388256.370908:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17888:x1874211971981952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787388256.370934:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787388256.370980:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17888:x1874211971981952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 74us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388256.370987:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787388256.371042:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273f5cc5180 x1874211971981952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787388272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388256.371058:0:17888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1874211971981952:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787388256.371067:0:17888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787388256.371092:0:17888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1874211971982080:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787388256.371119:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388256.373628:0:17888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388256.373672:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982080 00000100:00100000:2.0:1787388256.373693:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982080 00000100:00100000:2.0:1787388256.373738:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787388256.373746:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17888:x1874211971982080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787388256.373786:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1787388256.394479:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787388256.394493:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787388256.395183:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17888:x1874211971982080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 21432us (24056us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787388256.395195:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787388256.395305:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273ffa4d500 x1874211971982080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787388272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388256.395318:0:17888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787388256.395325:0:17888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1874211971982080:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787388256.395341:0:17888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787388256.395391:0:17888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1874211971982208:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787388256.395443:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388256.395510:0:17888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ff9c1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388256.395553:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982208 00000100:00100000:1.0:1787388256.395560:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982208 00000100:00100000:1.0:1787388256.395630:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388256.395639:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1874211971982208:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787388256.395808:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1874211971982208:12345-0@lo:900:osp-pre-0-1.0 Request processed in 169us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388256.395815:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787388256.395881:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9273ffa4d500 x1874211971982208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787388272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388256.395892:0:17888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1874211971982208:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787388256.840451:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388257.799917:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971982336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388257.800006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.800086:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982336 00000100:00100000:3.0:1787388257.800095:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982336 00000100:00100000:3.0:1787388257.800150:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787388257.800160:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971982336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388257.800196:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388257.800986:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971982336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 824us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.800995:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787388257.803469:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971982336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388257.803506:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388257.803519:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971982464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388257.803591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388257.804104:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982464 00000100:00100000:2.0:1787388257.804111:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982464 00000100:00100000:2.0:1787388257.804170:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787388257.804182:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971982464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388257.804217:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388257.804437:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971982464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 256us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388257.804446:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787388257.806632:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971982464:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388257.868639:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388258.892467:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388259.913391:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787388260.360548:0:19465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787388260.360552:0:19465:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787388260.360554:0:19465:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787388260.360725:0:19465:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9272c36c9000 00000020:01000004:3.0:1787388260.360742:0:19465:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787388260.360756:0:19465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787388260.360770:0:19465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9273d0f43380) 00000020:00000080:3.0:1787388260.360789:0:19465:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787388260.437265:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787388260.438385:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787388260.438807:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787388260.439242:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787388260.439596:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787388260.440864:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787388260.441581:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1787388260.449282:0:19465:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787388260.450448:0:19465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787388260.450467:0:19465:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787388260.450495:0:19465:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5cb77467b1812e87 00000020:01000004:3.0:1787388260.450502:0:19465:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787388260.450527:0:19465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787388260.450530:0:19465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787388260.450538:0:19465:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787388260.450575:0:19465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787388260.450580:0:19465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787388260.479378:0:19465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787388260.479436:0:19465:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.152@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787388260.479441:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787388260.479443:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787388260.479444:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388260.479445:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388260.479446:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388260.479448:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388260.479449:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388260.479451:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388260.479453:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787388260.479457:0:19465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787388260.479459:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787388260.479460:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787388260.479461:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388260.479463:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388260.479464:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388260.479465:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388260.479466:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388260.479467:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388260.479468:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787388260.479494:0:19465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787388260.479516:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787388260.479589:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.479720:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30e8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.480464:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982592 00000100:00100000:0.0:1787388260.480474:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982592 00000100:00100000:0.0:1787388260.480580:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787388260.480591:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:19465:x1874211971982592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787388260.480627:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787388260.480630:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787388260.480634:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787388260.481210:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:19465:x1874211971982592:12345-0@lo:253:mount.lustre.0 Request processed in 619us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.481220:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787388260.481307:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787388260.481319:0:19465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787388260.481322:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787388260.481335:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787388260.481336:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388260.481337:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388260.481346:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388260.481348:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388260.481349:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388260.481351:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388260.481352:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787388260.481371:0:19465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9272c36c9000 from lustre-OST0001 10000000:01000000:2.0:1787388260.481396:0:19465:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787388260.481399:0:19465:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787388260.481406:0:19465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9273ff9419c0 local copy 00010000:00010000:2.0:1787388260.481415:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388260.481509:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388260.481544:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.481722:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30e8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787388260.481817:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982720 00000100:00100000:1.0:1787388260.481822:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982720 00000100:00100000:1.0:1787388260.481849:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787388260.481857:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:19465:x1874211971982720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388260.481932:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:19465:x1874211971982720:12345-0@lo:501:mount.lustre.0 Request processed in 75us (387us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787388260.481939:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787388260.482123:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982720:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787388260.482137:0:19465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787388260.482155:0:19465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787388260.482161:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.482169:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020a00/0x5cb77467b1812ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ba8 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388260.482193:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9272c36c9000 10000000:01000000:2.0:1787388260.482198:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787388260.482203:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787388260.482207:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787388260.482211:0:19465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787388260.482214:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787388260.482238:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.482256:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.482266:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388260.482281:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388260.482310:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.482320:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30e8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787388260.482432:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982848 00000100:00100000:1.0:1787388260.482437:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982848 00000100:00100000:1.0:1787388260.482455:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787388260.482462:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:19465:x1874211971982848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388260.482470:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388260.482483:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273d1020c00/0x5cb77467b1812e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812e8e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.482504:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273d1020c00/0x5cb77467b1812e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812e8e expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.482524:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273d1020c00/0x5cb77467b1812e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e8e expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.482533:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020c00, rc 0) 00000100:00100000:1.0:1787388260.482572:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971982848:12345-0@lo:101:mount.lustre.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.482578:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787388260.482722:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388260.482736:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e95 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.482746:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812e95 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388260.484178:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787388260.484841:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388260.492365:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787388260.492423:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787388260.492441:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787388260.492455:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787388260.492470:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787388260.492483:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787388260.492511:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787388260.492518:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787388260.492635:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388260.492730:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.492800:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30e8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388260.493201:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971982976 00000100:00100000:1.0:1787388260.493209:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971982976 00000100:00100000:1.0:1787388260.493272:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787388260.493280:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971982976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388260.493463:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971982976:12345-0@lo:501:mount.lustre.0 Request processed in 182us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.493472:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787388260.493581:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971982976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388260.493627:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388260.493673:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388260.493719:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ca158e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388260.494146:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983104 00000100:00100000:1.0:1787388260.494153:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983104 00000100:00100000:1.0:1787388260.494283:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388260.494292:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388260.495854:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983104:12345-0@lo:503:mount.lustre.0 Request processed in 1555us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.495866:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388260.496029:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983104:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388260.496482:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388260.496587:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388260.496635:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.497982:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388260.498157:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983232 00000100:00100000:3.0:1787388260.498165:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983232 00000100:00100000:3.0:1787388260.498214:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787388260.498223:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388260.498829:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983232:12345-0@lo:502:mount.lustre.0 Request processed in 604us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388260.498838:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787388260.499024:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388260.499262:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787388260.499294:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787388260.499310:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787388260.499337:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787388260.499355:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787388260.499370:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787388260.499383:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787388260.499397:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787388260.499407:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787388260.499443:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388260.499490:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.499519:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c367fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388260.500164:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983360 00000100:00100000:3.0:1787388260.500172:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983360 00000100:00100000:3.0:1787388260.500208:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787388260.500215:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388260.500335:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983360:12345-0@lo:502:mount.lustre.0 Request processed in 108us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388260.500342:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787388260.500697:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388260.500767:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787388260.500779:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787388260.502396:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787388260.502407:0:19469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787388260.502414:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388260.502417:0:19469:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787388260.502423:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388260.502438:0:19469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92740195b380) 00000020:00000080:1.0:1787388260.502464:0:19469:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787388260.502475:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787388260.502569:0:19469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9272c36c9000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787388260.502577:0:19469:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787388260.502583:0:19469:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5cb77467b1812ea3 00010000:00010000:1.0:1787388260.507985:0:19469:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787388260.508600:0:19469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787388260.510069:0:19469:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787388260.511223:0:19469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787388260.511241:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388260.511247:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388260.511249:0:19469:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787388260.511253:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388260.511256:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388260.511258:0:19469:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787388260.511260:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787388260.511263:0:19469:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787388260.511266:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388260.511268:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388260.511269:0:19469:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787388260.511272:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388260.511274:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388260.511276:0:19469:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787388260.511279:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787388260.511305:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388260.511308:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388260.511309:0:19469:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787388260.511312:0:19469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787388260.511494:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787388260.511533:0:19465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787388260.511561:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e95 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.511575:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3709800/0x5cb77467b1812e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812e95 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388260.511584:0:19465:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9272c36c9000 from 1 10000000:01000000:2.0:1787388260.511587:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388260.511628:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.511637:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.511649:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388260.511675:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388260.511773:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.511832:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c30e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.512232:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983488 00000100:00100000:0.0:1787388260.512241:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983488 00000100:00100000:0.0:1787388260.512300:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787388260.512311:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:19465:x1874211971983488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388260.512337:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388260.512351:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812eaa expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.512379:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.512391:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.512400:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23fe800, rc 0) 00000100:00100000:0.0:1787388260.512501:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983488:12345-0@lo:101:mount.lustre.0 Request processed in 192us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.512509:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787388260.512626:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388260.512641:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.512651:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388260.514915:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787388260.515240:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388260.515437:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787388260.515467:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787388260.515492:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787388260.515499:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787388260.515579:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388260.515650:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388260.515745:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983616 00000100:00100000:0.0:1787388260.515755:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983616 00000100:00100000:0.0:1787388260.515811:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787388260.515820:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388260.515942:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983616:12345-0@lo:501:mount.lustre.0 Request processed in 123us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.515950:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787388260.516441:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388260.516467:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388260.516502:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388260.516543:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.516566:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388260.516778:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983744 00000100:00100000:3.0:1787388260.516784:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983744 00000100:00100000:3.0:1787388260.516822:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388260.516830:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388260.516936:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983744:12345-0@lo:503:mount.lustre.0 Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388260.516944:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787388260.517047:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388260.517424:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388260.517491:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388260.517533:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.517756:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.517860:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971983872 00000100:00100000:0.0:1787388260.517865:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971983872 00000100:00100000:0.0:1787388260.517904:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787388260.517913:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388260.518013:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971983872:12345-0@lo:502:mount.lustre.0 Request processed in 101us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.518019:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388260.518168:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971983872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388260.518356:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787388260.518392:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787388260.518407:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787388260.518419:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787388260.518432:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787388260.518443:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787388260.518457:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787388260.518469:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787388260.518481:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787388260.518492:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787388260.518504:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787388260.518526:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388260.518561:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.518619:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.518658:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984000 00000100:00100000:0.0:1787388260.518663:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984000 00000100:00100000:1.0:1787388260.518930:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787388260.518945:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971984000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388260.519085:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971984000:12345-0@lo:502:mount.lustre.0 Request processed in 147us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.519093:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388260.519153:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388260.519202:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787388260.519212:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787388260.519885:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388260.519897:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.519900:0:19473:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787388260.519908:0:19473:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9272c36c9000 00000020:00000080:0.0:1787388260.519911:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388260.519926:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388260.519929:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.519931:0:19473:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787388260.519933:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388260.519936:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.519937:0:19473:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787388260.519940:0:19473:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9272c36c9000 00000020:00000080:0.0:1787388260.519942:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388260.520028:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388260.520031:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.520032:0:19473:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787388260.520035:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388260.520037:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.520045:0:19473:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388260.520049:0:19473:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9272c36c9000 00000020:00000080:0.0:1787388260.520051:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388260.521809:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388260.521821:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.521823:0:19473:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388260.521828:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388260.521831:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.521832:0:19473:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787388260.521836:0:19473:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9272c36c9000 00000020:00000080:0.0:1787388260.521838:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388260.521887:0:19473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388260.521889:0:19473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388260.521891:0:19473:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787388260.521894:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787388260.522777:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787388260.522814:0:19465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388260.522867:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.522880:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388260.522935:0:19465:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787388260.522938:0:19465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9272c36c9000 10000000:01000000:0.0:1787388260.522941:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9272c36c9000 10000000:01000000:0.0:1787388260.522945:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787388260.522951:0:19465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9272c36c9000 from 1 10000000:01000000:0.0:1787388260.522954:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787388260.522993:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.523012:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.523024:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388260.523048:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787388260.523114:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388260.523175:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984128 00000100:00100000:0.0:1787388260.523181:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984128 00000100:00100000:0.0:1787388260.523231:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787388260.523240:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:19465:x1874211971984128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388260.523254:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388260.523267:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1812ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812eb8 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.523290:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1812ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812eb8 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.523301:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ffc00/0x5cb77467b1812ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812eb8 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.523309:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ffc00, rc 0) 00000100:00100000:0.0:1787388260.523358:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984128:12345-0@lo:101:mount.lustre.0 Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.523365:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787388260.523408:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273fb0c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.523435:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388260.523448:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ebf expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388260.523458:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812ebf expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388260.526314:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1787388260.526661:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388260.527176:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787388260.527201:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787388260.527222:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787388260.527234:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787388260.527245:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787388260.527256:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787388260.527267:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787388260.527277:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787388260.527288:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787388260.527299:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787388260.527309:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787388260.527320:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787388260.527345:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787388260.527356:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787388260.527367:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787388260.527377:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787388260.527388:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787388260.527398:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787388260.527409:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787388260.527421:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787388260.527433:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787388260.527444:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787388260.527457:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787388260.527469:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787388260.527479:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787388260.527490:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787388260.527501:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787388260.527510:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787388260.527520:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787388260.527530:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787388260.527540:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787388260.527552:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787388260.527562:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787388260.527573:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787388260.527584:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787388260.527604:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787388260.527614:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787388260.527625:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787388260.527649:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1787388260.527663:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1787388260.527675:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1787388260.527851:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1787388260.527865:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1787388260.527878:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1787388260.527889:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1787388260.527901:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1787388260.527922:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1787388260.527928:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1787388260.528016:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388260.528085:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.528130:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.528187:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984256 00000100:00100000:0.0:1787388260.528195:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984256 00000100:00100000:0.0:1787388260.528284:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787388260.528293:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388260.528445:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984256:12345-0@lo:501:mount.lustre.0 Request processed in 152us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.528453:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787388260.528530:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388260.528565:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388260.528608:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.528631:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388260.528634:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984384 00000100:00100000:1.0:1787388260.528638:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984384 00000100:00100000:0.0:1787388260.528675:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787388260.528750:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388260.528829:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984384:12345-0@lo:503:mount.lustre.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.528836:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787388260.528904:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787388260.529234:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787388260.529291:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388260.529422:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.529491:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388260.529525:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984512 00000100:00100000:0.0:1787388260.529530:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984512 00000100:00100000:0.0:1787388260.529585:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787388260.529593:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388260.529673:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984512:12345-0@lo:502:mount.lustre.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388260.529703:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787388260.529783:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388260.529934:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787388260.529961:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787388260.529976:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787388260.529988:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787388260.529999:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787388260.530022:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787388260.530037:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787388260.530049:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787388260.530061:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787388260.530072:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787388260.530085:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787388260.530098:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787388260.530111:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787388260.530123:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787388260.530136:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787388260.530148:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787388260.530161:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787388260.530172:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787388260.530186:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787388260.530198:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787388260.530210:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787388260.530235:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787388260.530250:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787388260.530263:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787388260.530275:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787388260.530286:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787388260.530298:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787388260.530310:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787388260.530335:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787388260.530350:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787388260.530362:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787388260.530375:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787388260.530387:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787388260.530400:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787388260.530422:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787388260.530435:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787388260.530447:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787388260.530470:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787388260.530484:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787388260.530497:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787388260.530509:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787388260.530520:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787388260.530531:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787388260.530541:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787388260.530552:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787388260.530563:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787388260.530577:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787388260.530591:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787388260.530626:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388260.530671:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.530723:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984640 00000100:00100000:2.0:1787388260.530728:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984640 00000100:00100000:2.0:1787388260.530755:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787388260.530761:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388260.530848:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984640:12345-0@lo:502:mount.lustre.0 Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.530854:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787388260.530894:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388260.530910:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388260.531025:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787388260.531060:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787388260.531082:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388260.531116:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.531144:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984768 00000100:00100000:2.0:1787388260.531148:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984768 00000100:00100000:2.0:1787388260.531171:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787388260.531177:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388260.531247:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971984768:12345-0@lo:502:mount.lustre.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.531254:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787388260.531348:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388260.531361:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971984768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388260.531396:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787388260.531403:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787388260.532573:0:19478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787388260.532596:0:19478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9272c34d3380) 00000020:00000080:2.0:1787388260.532620:0:19478:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787388260.534440:0:19478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9272c36c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787388260.534450:0:19478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9272c36c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787388260.534454:0:19478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9272c36c9000 3 00010000:00080000:2.0:1787388260.534495:0:19478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c34df000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.152@tcp at head 00010000:00010000:2.0:1787388260.536130:0:19478:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787388260.536232:0:19478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787388260.536280:0:19478:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787388260.536291:0:19478:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5cb77467b1812ecd 00000100:00080000:2.0:1787388260.536302:0:19478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388260.536308:0:19478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9272c34df000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787388260.536367:0:19478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c34bca80 x1874211971984896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388260.536397:0:19478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787388260.536450:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388260.536459:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388260.536462:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388260.536465:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388260.536498:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388260.536501:0:14986:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787388260.536504:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388260.536508:0:14986:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:2.0:1787388260.536514:0:14986:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787388260.536518:0:14986:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9273eecb0000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787388260.536530:0:14986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c34bdf80 x1874211971985536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388260.536584:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971985024:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536652:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.536701:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971985664:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.536751:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787388260.536757:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971985152:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536779:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.536796:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971985792:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.536868:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971985280:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536893:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.536908:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971985920:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.536951:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388260.536957:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971985408:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.536983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.537018:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985024 00000100:00100000:2.0:1787388260.537024:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985024 00000100:00100000:2.0:1787388260.537054:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985280 00000100:00100000:2.0:1787388260.537057:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985280 00000100:00100000:2.0:1787388260.537072:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388260.537080:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971985024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537134:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971985024:12345-0@lo:400:kworker.0 Request processed in 54us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537141:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388260.537157:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787388260.537162:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971985280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537193:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971985280:12345-0@lo:400:kworker.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537199:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787388260.537220:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985664 00000100:00100000:2.0:1787388260.537224:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985664 00000100:00100000:2.0:1787388260.537242:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985152 00000100:00100000:2.0:1787388260.537245:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985152 00000100:00100000:2.0:1787388260.537254:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985792 00000100:00100000:2.0:1787388260.537257:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985792 00000100:00100000:2.0:1787388260.537280:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985920 00000100:00100000:2.0:1787388260.537283:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985920 00000100:00100000:2.0:1787388260.537297:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787388260.537302:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971985664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537356:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971985664:12345-0@lo:400:kworker.0 Request processed in 52us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537363:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787388260.537375:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388260.537381:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971985152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537405:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971985152:12345-0@lo:400:kworker.0 Request processed in 24us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537410:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388260.537419:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388260.537424:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971985792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537443:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971985792:12345-0@lo:400:kworker.0 Request processed in 19us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537448:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388260.537456:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388260.537460:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971985920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537481:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971985920:12345-0@lo:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537487:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388260.537512:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985408 00000100:00100000:2.0:1787388260.537515:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985408 00000100:00100000:2.0:1787388260.537546:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388260.537552:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971985408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537579:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971985408:12345-0@lo:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388260.537585:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787388260.537605:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388260.537609:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388260.537611:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787388260.537635:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bfb80 x1874211971985408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.537648:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971985408:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537658:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971985280:0@lo:400:kworker.0 00010000:00080000:2.0:1787388260.537667:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bc000 x1874211971985920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.537675:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971985920:0@lo:400:kworker.0 00010000:00080000:2.0:1787388260.537724:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34be300 x1874211971985152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.537733:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971985152:0@lo:400:kworker.0 00010000:00080000:2.0:1787388260.537744:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bd880 x1874211971985792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.537751:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971985792:0@lo:400:kworker.0 00000100:00100000:2.0:1787388260.537760:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971985024:0@lo:400:kworker.0 00010000:00080000:2.0:1787388260.537769:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bd500 x1874211971985664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.537776:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971985664:0@lo:400:kworker.0 00000020:01000004:2.0:1787388260.538012:0:19478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787388260.538027:0:19478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9272c34d0000) 00000020:00000080:2.0:1787388260.538049:0:19478:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787388260.538194:0:19478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9272c36c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787388260.538199:0:19478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9272c36c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787388260.538202:0:19478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9272c36c9000 3 00010000:00080000:2.0:1787388260.538229:0:19478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9272c34dc800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.152@tcp at head 00000100:00100000:1.0:1787388260.539282:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971984896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787388260.539361:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.539408:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971985536:0@lo:8:kworker.0 00000100:00100000:1.0:1787388260.539433:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388260.539510:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971984896 00000100:00100000:1.0:1787388260.539516:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971984896 00000100:00100000:1.0:1787388260.539547:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388260.539554:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971984896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787388260.539577:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:1.0:1787388260.539623:0:17146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5cb77467b1812edb 00000004:00100000:1.0:1787388260.539639:0:17146:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787388260.539670:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9273f72cf000 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1787388260.539919:0:19478:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787388260.540005:0:19478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787388260.540044:0:19478:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787388260.540051:0:19478:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5cb77467b1812ee2 00000100:00080000:2.0:1787388260.540064:0:19478:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388260.540069:0:19478:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9272c34dc800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:2.0:1787388260.540095:0:19478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c4489180 x1874211971986048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388260.540124:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874211971986048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787388260.540161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.540198:0:17148:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787388260.540206:0:17148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1787388260.540315:0:19478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787388260.540346:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388260.540351:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388260.540354:0:14986:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388260.540356:0:14986:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388260.540740:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874211971984896:12345-0@lo:38:llog_process_th.0 Request processed in 1184us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.540752:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388260.540769:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986048 00000100:00100000:1.0:1787388260.540774:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986048 00000100:00100000:1.0:1787388260.540794:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388260.540800:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874211971986048:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787388260.540881:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c34bca80 x1874211971984896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.540891:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388260.540899:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787388260.540906:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787388260.540915:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787388260.540918:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c34df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787388260.540925:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874211971984896:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787388260.541507:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:1.0:1787388260.541542:0:17146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5cb77467b1812ee9 00000004:00100000:1.0:1787388260.541556:0:17146:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787388260.541589:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9273f72c8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388260.541746:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874211971986048:12345-0@lo:38:llog_process_th.0 Request processed in 944us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.541755:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388260.541785:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971985536 00000100:00100000:1.0:1787388260.541790:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971985536 00000100:00100000:1.0:1787388260.541815:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388260.541821:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971985536:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787388260.541967:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874211971985536:12345-0@lo:8:kworker.0 Request processed in 144us (2532us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787388260.541975:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787388260.543394:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9272c4489180 x1874211971986048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388260.543407:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388260.543415:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787388260.543423:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787388260.543428:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787388260.543431:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c34dc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787388260.543437:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874211971986048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787388260.543458:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388260.543462:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388260.543465:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787388260.543468:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971985536:0@lo:8:kworker.0 00000040:00080000:2.0:1787388260.543927:0:19478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787388260.544466:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787388260.544503:0:19465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787388260.544526:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ebf expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388260.544538:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23fe200/0x5cb77467b1812eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812ebf expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787388260.544672:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787388260.544675:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787388260.544701:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388260.544703:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388260.544704:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388260.544705:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388260.544706:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388260.544708:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388260.544710:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787388260.544714:0:19465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787388260.544717:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787388260.544718:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787388260.544720:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388260.544721:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388260.544723:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388260.544724:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388260.544725:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388260.544726:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388260.544727:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787388260.544750:0:19465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787388260.544766:0:19465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971986176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787388260.544834:0:19465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388260.544868:0:19465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0662600 going to sleep for 11 seconds 00000100:00100000:2.0:1787388260.544890:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986176 00000100:00100000:2.0:1787388260.544897:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986176 00000100:00100000:2.0:1787388260.544936:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787388260.544944:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971986176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787388260.544968:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787388260.545047:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787388260.555630:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787388260.555651:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787388260.555723:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787388260.555729:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787388260.555753:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.555772:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.555795:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.555803:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.555841:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.555854:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.555869:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971986304:0@lo:104: 00000100:00100000:3.0:1787388260.555932:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787388260.555992:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.556001:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 24 pid: 17141 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388260.556009:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:19465:x1874211971986176:12345-0@lo:253:mount.lustre.0 Request processed in 11061us (11171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388260.556014:0:17162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971986432:0@lo:104: 00000100:00100000:2.0:1787388260.556029:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787388260.556043:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388260.556063:0:17162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c31f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388260.556116:0:19465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3be7e40-7086-4e4f-aad1-8d3798e099a7:19465:1874211971986176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787388260.556128:0:19465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787388260.556137:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787388260.556139:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787388260.556140:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388260.556141:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388260.556142:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388260.556144:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388260.556145:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388260.556147:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388260.556149:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787388260.556163:0:19465:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787388260.556422:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986304 00000100:00100000:1.0:1787388260.556430:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986304 00000100:00100000:1.0:1787388260.556459:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986432 00000100:00100000:1.0:1787388260.556462:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986432 00000100:00100000:1.0:1787388260.556474:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388260.556481:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:17162:x1874211971986304:12345-0@lo:104: 00010000:00010000:1.0:1787388260.556494:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556555:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787388260.556560:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:17162:x1874211971986304:12345-0@lo:104: Request processed in 81us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.556566:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388260.556588:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787388260.556595:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971986432:12345-0@lo:104: 00010000:00010000:1.0:1787388260.556604:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.556616:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971986304:0@lo:104: 00010000:00010000:1.0:1787388260.556661:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787388260.556666:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:17162:x1874211971986432:12345-0@lo:104: Request processed in 72us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.556673:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787388260.556710:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388260.556716:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556725:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020600 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388260.556729:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556737:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.556743:0:17162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1874211971986432:0@lo:104: 10000000:00010000:1.0:1787388260.556746:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388260.556755:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787388260.556762:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556783:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556805:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388260.556835:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556854:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9273d1020600/0x5cb77467b1812e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e72 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.556855:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971986560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388260.556873:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388260.556878:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556884:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388260.556888:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.556895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787388260.556903:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388260.556911:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388260.556916:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787388260.556934:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.556939:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986560 00010000:00010000:1.0:1787388260.556940:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787388260.556944:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986560 00010000:00010000:1.0:1787388260.556961:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.556964:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556974:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23fe000/0x5cb77467b1812e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388260.556994:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388260.556995:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787388260.557003:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388260.557005:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3647:x1874211971986560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388260.557007:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388260.557016:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388260.557018:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388260.557025:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388260.557033:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971986688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388260.557037:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557052:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812e6b expref: 24 pid: 17140 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557065:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388260.557067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388260.557103:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:3647:x1874211971986560:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388260.557105:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787388260.557114:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388260.557116:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787388260.557131:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986688 00000100:00100000:3.0:1787388260.557136:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986688 00010000:00010000:3.0:1787388260.557149:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 23 pid: 17141 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388260.557177:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787388260.557183:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:3644:x1874211971986688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388260.557191:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388260.557195:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 23 pid: 17141 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557204:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 23 pid: 17141 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557215:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c3708a00/0x5cb77467b1812e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812e5d expref: 23 pid: 17141 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557227:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557236:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787388260.557249:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006703541s 00010000:00010000:3.0:1787388260.557253:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557260:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557265:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557271:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557284:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388260.557288:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557295:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557307:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557315:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388260.557355:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:3644:x1874211971986688:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388260.557361:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787388260.557387:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971986560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388260.557402:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557409:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388260.557415:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273eef96800/0x5cb77467b1812ef0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388260.557547:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971986688:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1787388260.579847:0:19465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787388260.586188:0:19465:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787388260.586198:0:19465:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787388260.586234:0:19465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787388260.586280:0:19465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787388260.586298:0:19465:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787388260.586334:0:19465:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787388260.587242:0:19465:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388260.587480:0:19465:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388260.937245:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388261.259432:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388261.384914:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971986816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388261.384997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388261.385634:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986816 00000100:00100000:3.0:1787388261.385643:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986816 00000100:00100000:3.0:1787388261.385718:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787388261.385730:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971986816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388261.385776:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388261.386731:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971986816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1000us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388261.386743:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000004:2.0:1787388261.389661:0:19534:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388261.390580:0:19534:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1787388261.391967:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273ffa4d180 x1874211971986816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388261.391995:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971986816:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1787388261.639956:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787388261.640120:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9273c2f5e000 from 10 10000000:01000000:2.0:1787388261.640126:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787388261.640176:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388261.640189:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388261.640200:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388261.640227:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971986944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388261.640568:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388261.640722:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f17b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388261.641031:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971986944 00000100:00100000:0.0:1787388261.641040:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971986944 00000100:00100000:0.0:1787388261.641208:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787388261.641218:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971986944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388261.641231:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388261.641248:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c23ff200/0x5cb77467b1812efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812ef7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.641273:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c23ff200/0x5cb77467b1812efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812ef7 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.641283:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c23ff200/0x5cb77467b1812efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812ef7 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.641313:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c23ff200, rc 0) 00000100:00100000:0.0:1787388261.641386:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971986944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388261.641401:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787388261.641439:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971986944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388261.641457:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812efe expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388261.641467:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812efe expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388261.641546:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971987072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388261.641599:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388261.643425:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388261.644274:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987072 00000100:00100000:0.0:1787388261.644286:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987072 00000100:00100000:3.0:1787388261.644415:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787388261.644427:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971987072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388261.644452:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388261.644474:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388261.644477:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787388261.644631:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971987072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 207us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388261.644640:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787388261.645151:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971987072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787388261.645224:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787388261.645233:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812efe expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.645243:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708800/0x5cb77467b1812ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812efe expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388261.645253:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787388261.645256:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff927401a55800 from 10 10000000:01000000:0.0:1787388261.645260:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787388261.645287:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.645294:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.645313:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388261.645332:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971987200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388261.645368:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388261.645393:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388261.645785:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987200 00000100:00100000:3.0:1787388261.645791:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987200 00000100:00100000:3.0:1787388261.646317:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388261.646327:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971987200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388261.646339:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388261.646352:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1812f05 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388261.646374:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1812f05 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388261.646384:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef97c00/0x5cb77467b1812f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812f05 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388261.646393:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97c00, rc 0) 00000100:00100000:3.0:1787388261.647413:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971987200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1083us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388261.647437:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787388261.648221:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971987200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388261.648242:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812f0c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388261.648253:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1812f0c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388261.648650:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971987328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388261.648855:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388261.648955:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44780 going to sleep for 11 seconds 00000100:00100000:2.0:1787388261.652766:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987328 00000100:00100000:2.0:1787388261.652781:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987328 00000100:00100000:2.0:1787388261.652832:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787388261.652841:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971987328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787388261.652868:0:17141:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787388261.652892:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787388261.652894:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787388261.653421:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971987328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388261.659752:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388261.659766:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812f0c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388261.659778:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c23ff800/0x5cb77467b1812f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1812f0c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388261.664562:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971987328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 11709us (15693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388261.664578:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:1.0:1787388261.960329:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388262.924427:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388262.924450:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971987456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388262.924517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388262.924561:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987456 00000100:00100000:3.0:1787388262.924569:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987456 00000100:00100000:3.0:1787388262.924619:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787388262.924628:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971987456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388262.924663:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388262.924732:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971987456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388262.924741:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787388262.924975:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971987456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388262.927143:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388262.927167:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971987584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388262.927241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388262.927442:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987584 00000100:00100000:3.0:1787388262.927451:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987584 00000100:00100000:3.0:1787388262.927503:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787388262.927511:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971987584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388262.927548:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787388262.927612:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971987584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388262.927619:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388262.927656:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971987584:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388262.984035:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388263.623942:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388243/real 1787388243] req@ffff9273ffa7f800 x1874211971974272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388263.624190:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7f800 x1874211971974272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388263.624200:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388243/real 1787388243] req@ffff9273ffa7d880 x1874211971974400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388263.624213:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9273ffa7d880 x1874211971974400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388263.624233:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388263.624258:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787388263.624275:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971974272:0@lo:8:kworker.0 00000100:00080000:0.0:1787388263.624280:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388263.624286:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787388263.624288:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971974400:0@lo:8:kworker.0 00000100:00100000:2.0:1787388263.625030:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388263.625048:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971987712:0@lo:400:kworker.0 00000100:00080000:1.0:1787388263.625083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388263.625088:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787388263.625090:0:8:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388263.625096:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1787388263.625101:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1787388263.625130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.625178:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971987840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.625208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.625241:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987712 00000100:00100000:2.0:1787388263.625248:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987712 00000100:00100000:2.0:1787388263.625305:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787388263.625313:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3645:x1874211971987712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.625361:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3645:x1874211971987712:12345-0@lo:400:kworker.0 Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.625368:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787388263.625414:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971987712:0@lo:400:kworker.0 00000100:00100000:0.0:1787388263.625635:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987840 00000100:00100000:0.0:1787388263.625640:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987840 00000100:00100000:0.0:1787388263.625698:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787388263.625706:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971987840:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787388263.625859:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9272c2371800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388263.625882:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273f5cc7480 x1874211971987968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388263.625905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388263.625909:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787388263.625911:0:8:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388263.625915:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1787388263.625918:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787388263.625921:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9273c9716800 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388263.625943:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9273f5cc4000 x1874211971988096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388263.626024:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971987968:0@lo:8:kworker.0 00000100:00100000:2.0:1787388263.626057:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.626085:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971988096:0@lo:8:kworker.0 00000100:00080000:1.0:1787388263.626100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1787388263.626166:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971987840:12345-0@lo:400:kworker.0 Request processed in 57us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.626173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388263.626182:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787388263.626202:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971987968 00000100:00100000:2.0:1787388263.626206:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971987968 00000100:00100000:0.0:1787388263.626215:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971987840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.626223:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988096 00000100:00100000:2.0:1787388263.626226:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988096 00000100:00100000:0.0:1787388263.626229:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388263.626234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971988480:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.626238:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388263.626250:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874211971987968:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787388263.626257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787388263.626288:0:19203:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1787388263.626317:0:19203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812f13 00002000:00100000:2.0:1787388263.626330:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9272c34d9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787388263.626334:0:19203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787388263.626337:0:19203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1787388263.626344:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787388263.626347:0:8:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388263.626352:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9273eecb0000 using connection 192.168.204.152@tcp/0@lo 00000100:00100000:1.0:1787388263.626365:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9272c3c57800 x1874211971988608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00080000:2.0:1787388263.626408:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787388263.626426:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971988224:0@lo:400:kworker.0 00000100:00080000:2.0:1787388263.626428:0:19203:0:(import.c:65:import_set_state_nolock()) ffff9272c34da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388263.626454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.626457:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1874211971987968:12345-0@lo:8:kworker.0 Request processed in 207us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.626463:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388263.626472:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971988864:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.626473:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988480 00000100:00100000:2.0:1787388263.626476:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988480 00000100:00100000:1.0:1787388263.626492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.626503:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388263.626509:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971988480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.626538:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971988480:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.626544:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388263.626626:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388263.626631:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874211971988096:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787388263.626647:0:19203:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1787388263.626664:0:19203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5cb77467b1812f1a 00002000:00100000:2.0:1787388263.626670:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9272c34db000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787388263.626673:0:19203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787388263.626675:0:19203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787388263.626836:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1787388263.626847:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971988608:0@lo:8:kworker.0 00000100:00080000:2.0:1787388263.626862:0:19203:0:(import.c:65:import_set_state_nolock()) ffff9272c34dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388263.626872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.626889:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1874211971988096:12345-0@lo:8:kworker.0 Request processed in 256us (715us total) trans 0 rc 0/0 00010000:00080000:0.0:1787388263.626892:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc7480 x1874211971987968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388263.626896:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388263.626900:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388263.626906:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787388263.626913:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787388263.626917:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787388263.626919:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9272c2371800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787388263.626932:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787388263.626936:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971987968:0@lo:8:kworker.0 00010000:00080000:0.0:1787388263.626949:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc4000 x1874211971988096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388263.627063:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988224 00000100:00100000:3.0:1787388263.627068:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988224 00000100:00100000:1.0:1787388263.627068:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787388263.627074:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971988352:0@lo:400:kworker.0 00000100:00100000:3.0:1787388263.627095:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988864 00000100:00100000:3.0:1787388263.627098:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988864 00000100:00100000:1.0:1787388263.627098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388263.627240:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787388263.627247:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971988224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388263.627298:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874211971988224:12345-0@lo:400:kworker.0 Request processed in 51us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.627304:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787388263.627317:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787388263.627322:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971988864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388263.627346:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211971988864:12345-0@lo:400:kworker.0 Request processed in 24us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.627352:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388263.627380:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971988992:0@lo:400:kworker.0 00000100:00100000:1.0:1787388263.627402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787388263.627424:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273f5cc5180 x1874211971988224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388263.627433:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874211971988224:0@lo:400:kworker.0 00010000:00080000:1.0:1787388263.627442:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c57100 x1874211971988864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388263.627449:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211971988864:0@lo:400:kworker.0 00000100:00100000:1.0:1787388263.627486:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988608 00000100:00100000:1.0:1787388263.627489:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988608 00000100:00080000:2.0:1787388263.627629:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388263.627629:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388263.627634:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388263.627635:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787388263.627640:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787388263.627644:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787388263.627646:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273c9716800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787388263.627671:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787388263.627676:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874211971988096:0@lo:8:kworker.0 00000004:00080000:2.0:1787388263.627747:0:17173:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000004:00080000:0.0:1787388263.627747:0:17171:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787388263.627762:0:17173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1874211971989632:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787388263.627787:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.627802:0:17173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273d0f70d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388263.627812:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989632 00000100:00100000:2.0:1787388263.627816:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989632 00000004:00080000:3.0:1787388263.627877:0:17172:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787388263.627954:0:17172:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 552612273474ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787388263.627971:0:17172:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787388263.627988:0:17171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1874211971989760:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787388263.628015:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388263.628026:0:17171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273eee28840 going to sleep for 11 seconds 00000004:00080000:0.0:1787388263.628038:0:17170:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787388263.628071:0:17170:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 552612391239ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787388263.628075:0:17170:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787388263.628908:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988992 00000100:00100000:0.0:1787388263.628916:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988992 00000100:00100000:0.0:1787388263.628957:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787388263.628967:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971988992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388263.629226:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211971988992:12345-0@lo:400:kworker.0 Request processed in 260us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388263.629234:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787388263.629259:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989760 00000100:00100000:0.0:1787388263.629274:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989760 00000100:00100000:2.0:1787388263.631698:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388263.631712:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874211971988608:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787388263.631747:0:19203:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1787388263.631779:0:19203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5cb77467b1812f21 00002000:00100000:2.0:1787388263.631794:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9272c34d9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366e ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787388263.631798:0:19203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787388263.631801:0:19203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787388263.632659:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787388263.632710:0:19203:0:(import.c:65:import_set_state_nolock()) ffff9272c34dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388263.632800:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3643:x1874211971988608:12345-0@lo:8:kworker.0 Request processed in 1088us (5925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.632810:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388263.632835:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388263.632843:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17173:x1874211971989632:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787388263.633830:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971989504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388263.633887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388263.633924:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388263.633931:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971989376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388263.633956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388263.634001:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989504 00000100:00100000:1.0:1787388263.634008:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989504 00000100:00100000:1.0:1787388263.634034:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989376 00000100:00100000:1.0:1787388263.634037:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989376 00000100:00100000:1.0:1787388263.634050:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388263.634056:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971989504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388263.634077:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787388263.634354:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787388263.634364:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:17171:x1874211971989760:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787388263.634663:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971989504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 606us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.634671:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388263.634705:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388263.634712:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971989376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388263.634726:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787388263.634756:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874211971989376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.635167:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:1.0:1787388263.636223:0:17126:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787388263.636240:0:17126:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:1.0:1787388263.636302:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c4489880 x1874211971989376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388263.636335:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971989376:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787388263.636350:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c446bb80 x1874211971989504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388263.636362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971989504:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787388263.636402:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c55880 x1874211971988992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388263.636411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211971988992:0@lo:400:kworker.0 00000100:00080000:2.0:1787388263.636619:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388263.636625:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388263.636628:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787388263.636717:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c57800 x1874211971988608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388263.636752:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787388263.636762:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787388263.636767:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787388263.636771:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9273eecb0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787388263.636780:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787388263.636786:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874211971988608:0@lo:8:kworker.0 00000004:00080000:1.0:1787388263.636876:0:17890:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787388263.636895:0:17890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1874211971990016:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787388263.636943:0:17890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388263.636972:0:17890:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44840 going to sleep for 11 seconds 00002000:00080000:1.0:1787388263.636994:0:19203:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787388263.637000:0:19203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787388263.637004:0:19203:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1787388263.637068:0:17889:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787388263.637256:0:17889:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 552621576278ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787388263.637275:0:17889:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787388263.637799:0:18653:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787388263.637807:0:18653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:0.0:1787388263.638649:0:18652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787388263.638658:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787388263.638662:0:18652:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:2.0:1787388263.638746:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988352 00000100:00100000:2.0:1787388263.638755:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988352 00000100:00100000:2.0:1787388263.638803:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388263.638812:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971988352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.638913:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971988352:12345-0@lo:400:kworker.0 Request processed in 102us (11813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.638922:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388263.638949:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971989120:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.638994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.639019:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971989888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388263.639045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.639066:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787388263.639074:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971988736:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.639272:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.639295:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971989248:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.639318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787388263.639366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c54380 x1874211971988480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388263.639380:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971988480:0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.643096:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989120 00000100:00100000:2.0:1787388263.643179:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989120 00000100:00100000:2.0:1787388263.643234:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971988736 00000100:00100000:2.0:1787388263.643238:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971988736 00000100:00100000:2.0:1787388263.643251:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989248 00000100:00100000:2.0:1787388263.643254:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989248 00000100:00100000:2.0:1787388263.643285:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388263.643295:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971989120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.643387:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211971989120:12345-0@lo:400:kworker.0 Request processed in 93us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.643395:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388263.643411:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388263.643417:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c448a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971988736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.643446:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c448a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211971988736:12345-0@lo:400:kworker.0 Request processed in 29us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.643452:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388263.643463:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388263.643469:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971989248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388263.643495:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211971989248:12345-0@lo:400:kworker.0 Request processed in 26us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.643511:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787388263.643532:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388263.643536:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787388263.643839:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c56a00 x1874211971988736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388263.644221:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211971988736:0@lo:400:kworker.0 00010000:00080000:2.0:1787388263.644237:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c56300 x1874211971989248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388263.644246:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211971989248:0@lo:400:kworker.0 00010000:00080000:2.0:1787388263.644256:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c56680 x1874211971989120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388263.644274:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211971989120:0@lo:400:kworker.0 00000100:00100000:1.0:1787388263.645293:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971988352:0@lo:400:kworker.0 00000100:00100000:1.0:1787388263.645327:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971989888 00000100:00100000:1.0:1787388263.645333:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971989888 00000100:00100000:1.0:1787388263.645380:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388263.645388:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971989888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388263.645409:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787388263.645470:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874211971989888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (6424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.645477:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787388263.645505:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388263.645528:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3c55880 x1874211971989888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388263.645545:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971989888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388263.647730:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990016 00000100:00100000:2.0:1787388263.647741:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990016 00000100:00100000:3.0:1787388263.647893:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787388263.647934:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17890:x1874211971990016:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:1.0:1787388263.652285:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.652300:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652317:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.652322:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.652328:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652346:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652358:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652366:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652387:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.652398:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.652404:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652423:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.652428:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652437:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652455:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652463:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812f28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.652481:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.652483:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.652486:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787388263.652488:0:17879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1787388263.654274:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.654283:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654298:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.654302:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.654308:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654320:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654336:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654345:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654364:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.654374:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.654380:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654388:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.654393:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654401:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654417:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654424:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1812f2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.654438:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.654446:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.654447:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.656258:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.656280:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656295:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.656300:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.656306:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656319:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656329:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656337:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656359:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.656373:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.656379:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656386:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.656390:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656409:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656424:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656431:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812f36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.656449:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.656451:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.656453:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.658454:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.658464:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.658478:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.658483:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.658488:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.658618:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.658629:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.658643:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.658667:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787388263.659042:0:19659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787388263.659048:0:19659:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787388263.659207:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17890:x1874211971990016:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11301us (22259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.659217:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388263.659318:0:17890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1874211971990016:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787388263.659332:0:17890:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787388263.659381:0:17890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1874211971990144:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787388263.659426:0:17890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388263.659466:0:17890:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388263.659569:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990144 00000100:00100000:3.0:1787388263.659576:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990144 00000100:00100000:3.0:1787388263.659630:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787388263.659639:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17890:x1874211971990144:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787388263.659662:0:18653:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787388263.659847:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17890:x1874211971990144:12345-0@lo:5:osp-pre-1-1.0 Request processed in 209us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.659853:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787388263.659859:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.659866:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.659876:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.659880:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.659895:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.659913:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.659920:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a867f1/0x5cb77467b1812f3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.659936:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.659938:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.659939:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.660008:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.660014:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660023:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.660026:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.660035:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388263.660176:0:17890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1874211971990144:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787388263.660186:0:17890:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787388263.660212:0:17890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1874211971990272:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787388263.660235:0:17890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388263.660252:0:17890:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273efb44840 going to sleep for 11 seconds 00002000:00010000:1.0:1787388263.660303:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.660309:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660317:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.660320:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.660324:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660334:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660349:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660355:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660370:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.660378:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.660382:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660388:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.660391:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660399:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660410:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660417:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.660429:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.660435:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.660437:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.660644:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660654:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660667:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660700:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.660708:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.660712:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660719:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.660722:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660852:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660865:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660872:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000164d189b/0x5cb77467b1812f44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.660886:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.660887:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.660889:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.661489:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.661851:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661865:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.661870:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.661875:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661884:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661893:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661901:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661920:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.661932:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.661937:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661944:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.661948:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661969:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661981:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.661989:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f06474/0x5cb77467b1812f52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.662004:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.662006:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.662008:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.662285:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.662300:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662310:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.662313:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.662318:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662327:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662336:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662343:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662359:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.662369:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.662372:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662379:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.662382:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662389:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662405:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.662411:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003058d39a/0x5cb77467b1812f59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388263.662420:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990272 00010000:00010000:0.0:1787388263.662425:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.662426:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388263.662428:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990272 00010000:00010000:0.0:1787388263.662428:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388263.662472:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787388263.662482:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17890:x1874211971990272:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787388263.662523:0:18653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1787388263.662920:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.662926:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.662935:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.662939:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.662943:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.662953:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.662961:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.662975:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.662989:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.662998:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.663002:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.663010:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.663013:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.663021:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.663035:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.663043:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1b0b13/0x5cb77467b1812f60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.663058:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.663060:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.663062:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.663252:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.663258:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663278:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.663281:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.663286:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663294:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663302:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663308:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663339:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388263.663874:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.663881:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663891:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.663894:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.663899:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663909:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663916:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663923:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663938:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787388263.663947:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388263.663952:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663959:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23fe000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.663968:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663976:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663988:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.663995:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043db74ef/0x5cb77467b1812f67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664009:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.664012:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664019:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.664022:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664029:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664038:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664044:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000367467d8/0x5cb77467b1812f6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664062:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.664063:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.664065:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.664479:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.664699:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.664706:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664715:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.664718:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.664723:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664743:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664750:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664756:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664778:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.664786:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.664790:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664808:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.664812:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664819:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664831:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664838:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad6d0b2/0x5cb77467b1812f75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.664851:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.664852:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.664854:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.665379:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.665386:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665395:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.665398:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.665402:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665411:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665425:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665432:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665447:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.665455:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.665459:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665465:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.665468:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665475:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665486:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665494:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47b1f68/0x5cb77467b1812f7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.665519:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.665526:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.665528:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.666074:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.666081:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.666091:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.666095:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.666099:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388263.666210:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.666216:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666224:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.666228:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.666231:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666241:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666249:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666257:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666281:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.666289:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.666293:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666301:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.666304:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666323:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666334:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666341:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009760018f/0x5cb77467b1812f8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.666353:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.666355:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.666356:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.666394:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.666402:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.666410:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.666431:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388263.666451:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.666456:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.666464:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.666467:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.666474:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.666486:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.666493:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa6e0fa2/0x5cb77467b1812f83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.666581:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.666583:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.666585:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.667061:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.667067:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.667076:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.667079:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.667084:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.667094:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.667101:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.667116:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.667141:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.667845:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.667852:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.667861:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.667865:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.667885:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.667899:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.667907:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ecc051/0x5cb77467b1812f91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.667923:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.667925:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.667927:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.668151:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.668157:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.668168:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.668171:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.668175:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.668185:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.668193:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.668201:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.668217:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388263.668395:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.668401:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668409:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.668412:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668420:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668432:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668439:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc4cd5/0x5cb77467b1812f98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668453:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.668455:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.668457:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.668602:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.668607:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.668615:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.668618:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.668622:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.668631:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.668639:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.668651:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.668671:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388263.668959:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.668964:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668972:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.668975:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.668995:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.669007:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.669015:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1812f9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.669031:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.669032:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.669034:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.669338:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.669344:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669358:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.669362:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.669366:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669375:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669382:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669390:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669405:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.669413:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.669416:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669423:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.669427:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669434:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669458:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669465:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1812fa6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.669479:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.669481:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.669482:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.669662:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.669668:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.669702:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.669706:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.669711:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.669720:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.669734:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.669742:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.669758:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.670142:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.670147:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.670162:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.670166:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.670174:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.670186:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.670194:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de5d6757/0x5cb77467b1812fad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.670210:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.670212:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.670213:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.671144:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.671153:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671165:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.671168:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.671174:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671185:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671194:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671202:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671235:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388263.671549:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.671555:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671563:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.671566:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.671569:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671578:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671586:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671594:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.671615:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787388263.671786:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388263.671794:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671804:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388263.671809:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671818:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671846:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671853:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e47b1f68/0x5cb77467b1812fb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671871:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388263.671875:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671881:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388263.671884:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671890:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671899:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671905:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad6d0b2/0x5cb77467b1812fbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.671916:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.671917:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.671924:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.672048:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.672211:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.672217:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.672227:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.672239:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.672244:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.672254:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.672271:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.672278:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.672290:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787388263.672587:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.672593:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672602:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.672605:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.672610:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672632:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672640:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672646:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672660:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787388263.672667:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388263.672671:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672701:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.672704:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672711:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672722:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672742:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000367467d8/0x5cb77467b1812fc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672868:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.672872:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672879:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.672882:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672889:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672900:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672908:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b1b0b13/0x5cb77467b1812fc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.672921:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.672923:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.672924:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.673193:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.673199:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673207:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.673216:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.673220:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673229:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673238:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673245:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673281:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.673289:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.673292:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673300:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.673303:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673310:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673319:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673336:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1812fd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673350:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.673352:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.673354:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.673893:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.673900:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673910:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.673913:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.673917:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673926:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673934:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673941:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673956:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.673965:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.673974:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673980:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.673984:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.673992:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.674004:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.674012:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001442105a/0x5cb77467b1812fd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.674025:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.674027:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.674029:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.674223:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.674230:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674238:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.674241:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.674245:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674254:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674274:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674287:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674306:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388263.674746:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.674753:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674871:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.674875:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.674879:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674889:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674897:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674905:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.674914:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787388263.675187:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388263.675193:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675202:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.675206:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675225:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675239:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675247:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048cd370d/0x5cb77467b1812fde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675274:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.675278:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675283:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.675286:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675293:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675302:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675308:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033513f8b/0x5cb77467b1812fe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675329:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.675330:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.675332:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.675462:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.675467:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675480:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.675482:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.675487:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675496:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675579:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675587:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675603:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.675611:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.675615:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675620:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.675623:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675630:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675652:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675659:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b1812fec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.675673:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.675674:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.675699:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.675904:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.675910:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675917:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.675920:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.675924:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675932:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675939:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675946:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.675962:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.676103:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.676108:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.676115:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.676118:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.676126:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.676136:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.676143:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383baec3/0x5cb77467b1812ff3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.676169:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.676171:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.676172:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.678432:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.678923:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1787388263.678923:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.678934:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.678934:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.678950:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.678954:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.678968:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.678972:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.678977:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.678990:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679000:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.679007:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679008:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.679017:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.679024:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679027:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.679031:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679036:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.679042:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.679042:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.679049:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.679053:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679060:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679088:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679095:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043c09125/0x5cb77467b1813001 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679124:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.679127:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679134:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.679137:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679145:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679154:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679161:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009760018f/0x5cb77467b1812ffa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.679173:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.679175:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.679182:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787388263.681492:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388263.681521:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.681537:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1787388263.681542:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388263.681548:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.681560:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.681572:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.681587:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.682697:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.683088:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.683096:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.683132:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.683136:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.683142:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.683154:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.683164:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.683171:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.683189:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.683650:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.683658:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.683667:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.683672:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.683732:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.683750:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.683758:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cf26ac4/0x5cb77467b181300f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.683773:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.683775:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.683777:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.684366:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388263.685077:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.685085:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.685096:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.685099:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.685108:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.685172:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.685180:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b67a585a/0x5cb77467b1813008 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.685196:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.685198:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.685200:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787388263.687189:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388263.687218:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687234:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1787388263.687238:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388263.687244:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687257:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687285:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687292:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687315:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388263.687326:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.687331:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687338:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.687343:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687350:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687374:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687382:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eafb782e/0x5cb77467b1813016 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.687399:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.687401:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.687403:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.689389:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.689402:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689418:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.689423:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.689429:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689443:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689465:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689472:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689490:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.689512:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.689518:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689525:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.689530:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689539:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689554:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689562:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b181301d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.689576:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.689583:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.689585:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787388263.690342:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.690350:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690360:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.690364:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.690369:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690379:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690388:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690396:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690412:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787388263.690871:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.690878:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690887:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.690890:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.690900:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690910:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690919:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690926:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690942:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787388263.690952:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388263.690957:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690964:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388263.690968:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690977:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.690990:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691008:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b1813024 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691023:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388263.691027:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691033:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388263.691036:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691044:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691054:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691062:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b181302b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.691072:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.691074:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.691075:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.691990:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.692000:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692011:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.692014:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.692019:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692030:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692039:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692046:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692064:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.692072:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.692076:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692083:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.692086:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692107:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692121:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692128:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c72dc8/0x5cb77467b1813032 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.692143:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.692144:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.692146:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787388263.692656:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.692663:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.692692:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.692696:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.692700:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.692710:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.692719:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.692931:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.694013:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.694048:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.694065:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.694072:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.694080:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.694084:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.694226:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.694248:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.694256:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089363963/0x5cb77467b1813039 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.694285:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.694287:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.694289:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.694732:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.694740:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.694752:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.694757:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1787388263.695656:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.695666:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.695693:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.695697:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.695703:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.695716:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.695748:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.695756:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695852:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695865:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695872:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695885:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695903:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.695915:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.695920:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695927:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.695931:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695938:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.695955:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.696586:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c5eadbd/0x5cb77467b1813040 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.696610:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.696612:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.696614:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.696877:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388263.696886:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388263.696892:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.696899:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388263.696903:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.696910:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.696924:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.696932:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc289aac/0x5cb77467b1813047 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.696946:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.696953:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.696955:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.697923:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.697941:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.697954:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.697957:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.698857:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.698874:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.698884:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.698892:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.699049:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.699589:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.699597:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.699607:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.699612:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.699621:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.699650:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.699658:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181304e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.699704:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.699707:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.699708:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787388263.699894:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.699901:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.699912:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.699915:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.699921:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.699931:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.699940:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.699947:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.699978:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.700435:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.700441:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.700450:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.700453:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.700461:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.700473:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.700479:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002616af6b/0x5cb77467b1813055 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.700519:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.700521:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.700523:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787388263.701077:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.701084:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.701095:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.701099:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.701106:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.701122:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.701130:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.701137:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.701158:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787388263.701244:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.701251:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.701270:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.701274:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.701279:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.701289:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.701297:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.701310:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.701330:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787388263.701865:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388263.701872:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.701880:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.701883:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.701891:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.701906:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.701913:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbdab16a/0x5cb77467b181305c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.701931:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.701934:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.701940:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.701952:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.702019:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.702031:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.702037:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c09125/0x5cb77467b1813063 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.702053:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.702055:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.702056:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.702883:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.704291:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.704304:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704321:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.704326:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.704332:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704346:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704356:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704371:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704395:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.704477:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.704483:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.704491:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.704496:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.704505:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.704521:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.704528:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b181306a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.704554:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.704555:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.704557:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.704635:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.704641:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704648:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.704651:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.704654:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704664:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704672:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704696:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.704708:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388263.705170:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388263.705176:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.705184:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388263.705188:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.705195:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.705209:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.705230:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5eadbd/0x5cb77467b1813071 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.705245:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.705247:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.705249:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.708704:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.708726:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.708743:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.708748:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.708754:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.708768:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.708779:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.708788:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.708808:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.708821:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.708826:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.708834:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.708839:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.710057:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.710091:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.710099:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001442105a/0x5cb77467b1813078 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.710356:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.710359:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.710361:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388263.710949:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388263.710958:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.710977:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787388263.710980:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388263.710987:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.710999:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711009:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711016:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711035:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388263.711045:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388263.711050:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711058:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496800 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388263.711062:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711071:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711094:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711101:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c72dc8/0x5cb77467b181307f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388263.711117:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.711118:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388263.711120:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787388263.711171:0:19203:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1787388263.711283:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17173:x1874211971989632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 78437us (83490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388263.711292:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388263.712534:0:17173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1874211971989632:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787388263.712551:0:17173:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787388263.712597:0:17173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1874211971990400:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787388263.712640:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388263.712673:0:17173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c9cb9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787388263.712858:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990400 00000100:00100000:3.0:1787388263.712865:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990400 00000100:00100000:3.0:1787388263.712906:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787388263.712915:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17173:x1874211971990400:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787388263.712951:0:18651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:2.0:1787388263.713197:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.713204:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.713218:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.713222:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.713227:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.713239:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.713248:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.713270:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.713291:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388263.713561:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388263.713568:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.713577:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:1.0:1787388263.713581:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.713591:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.713608:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.713616:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc289aac/0x5cb77467b1813086 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.713646:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.713648:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388263.713650:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787388263.717086:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.717100:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.717119:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.717124:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.717130:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.717145:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.717155:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.717163:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.717194:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388263.717626:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.717633:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.717641:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709600 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.717646:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.717654:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.717708:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.717715:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dde87e15/0x5cb77467b181308d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.717743:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.717745:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.717747:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388263.719870:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388263.719882:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.719897:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1787388263.719902:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388263.719908:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.719921:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.719930:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.719937:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388263.721026:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787388263.725992:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.726006:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.726032:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.726036:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.726043:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.726057:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.726066:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.726074:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388263.726552:0:19466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:0.0:1787388263.726563:0:19466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787388263.726594:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787388263.726598:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787388263.726807:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17890:x1874211971990272:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64322us (66566us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787388263.726817:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787388263.726870:0:17890:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787388263.726878:0:17890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1874211971990272:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787388263.726891:0:17890:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787388263.726939:0:17890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17890:1874211971990528:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787388263.726987:0:17890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388263.727012:0:17890:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388263.727030:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990528 00000100:00100000:0.0:1787388263.727037:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990528 00000100:00100000:0.0:1787388263.727074:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787388263.727081:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17890:x1874211971990528:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787388263.727127:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17890:x1874211971990528:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388263.727133:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787388263.727162:0:17890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c446bb80 x1874211971990528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787388279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388263.727173:0:17890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17890:1874211971990528:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787388263.727663:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17173:x1874211971990400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14747us (15020us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787388263.727672:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787388263.727899:0:17173:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787388263.727906:0:17173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1874211971990400:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787388263.727915:0:17173:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1787388263.728064:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388263.728074:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728086:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020200 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.728091:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728102:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728122:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728130:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f06474/0x5cb77467b1813094 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728166:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.728170:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728176:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708a00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.728179:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728187:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728197:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.728205:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.728206:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.728208:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.728341:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787388263.728348:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a78557f/0x5cb77467b181309b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388263.728986:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388263.728995:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.729006:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1787388263.729011:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388263.729017:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.729042:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.729052:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388263.729060:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.729483:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388263.729490:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.729506:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3708400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388263.729510:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.729533:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.729548:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388263.729557:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.729558:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388263.729560:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388263.729628:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787388263.729633:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbdab16a/0x5cb77467b18130a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787388263.729742:0:18652:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1787388263.729833:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17171:x1874211971989760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 95469us (101814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.729842:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388263.730083:0:17171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1874211971989760:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787388263.730105:0:17171:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787388263.730147:0:17171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1874211971990656:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787388263.730183:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388263.730214:0:17171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273ca158240 going to sleep for 11 seconds 00010000:00010000:3.0:1787388263.730275:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388263.730309:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990656 00000100:00100000:2.0:1787388263.730315:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990656 00000100:00100000:2.0:1787388263.730358:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388263.730367:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17171:x1874211971990656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787388263.730402:0:19203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1787388263.738569:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787388263.738612:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787388263.739248:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17171:x1874211971990656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8877us (9059us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787388263.739269:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787388263.739352:0:17171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787388263.739362:0:17171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1874211971990656:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787388263.739380:0:17171:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1787388264.012871:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388264.905097:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787388265.032987:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388266.056253:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388266.507563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971990784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388266.507630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388266.508447:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990784 00000100:00100000:3.0:1787388266.508458:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990784 00000100:00100000:3.0:1787388266.508523:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787388266.508531:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971990784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388266.508561:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388266.508618:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971990784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.508626:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787388266.508650:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388266.509012:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971990784:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787388266.550797:0:19824:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787388267.079806:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787388267.418592:0:19877:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388267.422418:0:19877:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787388268.041014:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388268.041041:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971990912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388268.041115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388268.041196:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971990912 00000100:00100000:3.0:1787388268.041204:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971990912 00000100:00100000:3.0:1787388268.041268:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787388268.041277:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971990912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388268.041312:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388268.041357:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971990912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.041364:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787388268.041408:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971990912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388268.044793:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388268.044818:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971991040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388268.044886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388268.046061:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991040 00000100:00100000:1.0:1787388268.046072:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991040 00000100:00100000:1.0:1787388268.046136:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787388268.046148:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971991040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388268.046202:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388268.046275:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971991040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388268.046282:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388268.046599:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971991040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388268.106496:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787388268.374995:0:19927:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388268.375245:0:19927:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787388268.660808:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.660984:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035520 00000100:00100000:2.0:1787388268.661020:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035520 00000100:00100000:2.0:1787388268.661080:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 113 00000100:00100000:2.0:1787388268.661091:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1874211953035520:12345-192.168.204.52@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787388268.661122:0:17141:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 952f6066-6f96-4bdc-ad92-884b088ec3d7@192.168.204.52@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1787388268.661150:0:17141:0:(genops.c:1406:class_connect()) connect: client 952f6066-6f96-4bdc-ad92-884b088ec3d7, cookie 0x5cb77467b18130a9 00000100:00080000:2.0:1787388268.661303:0:17141:0:(import.c:65:import_set_state_nolock()) ffff9272c207b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388268.661395:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+5:2400:x1874211953035520:12345-192.168.204.52@tcp:250:mount.lustre.0 Request processed in 304us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.661403:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 113 00000100:00100000:0.0:1787388268.679312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388268.684051:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035648 00000100:00100000:1.0:1787388268.684069:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035648 00000100:00100000:2.0:1787388268.689036:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 114 00000100:00100000:2.0:1787388268.689053:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+5:14932:x1874211953035648:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787388268.689074:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388268.689095:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c3708400/0x5cb77467b18130b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5063 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.689126:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3708400/0x5cb77467b18130b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5063 expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.689137:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c3708400/0x5cb77467b18130b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5063 expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.689146:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708400, rc 0) 00000100:00100000:2.0:1787388268.689226:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+6:14932:x1874211953035648:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 177us (9924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.689234:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 114 00000100:00100000:3.0:1787388268.698924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.699207:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035776 00000100:00100000:2.0:1787388268.699222:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035776 00000100:00100000:2.0:1787388268.699303:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 115 00000100:00100000:2.0:1787388268.699313:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+6:14932:x1874211953035776:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787388268.699459:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+6:14932:x1874211953035776:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 147us (545us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388268.699469:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 115 00000100:00100000:0.0:1787388268.707357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388268.707556:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953035904 00000100:00100000:3.0:1787388268.707567:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953035904 00000100:00100000:3.0:1787388268.707625:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 116 00000100:00100000:3.0:1787388268.707646:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+6:14932:x1874211953035904:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388268.707670:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388268.707711:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef96800/0x5cb77467b18130b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd506a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.707738:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96800/0x5cb77467b18130b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd506a expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.707749:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef96800/0x5cb77467b18130b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd506a expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.707776:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96800, rc 0) 00000100:00100000:3.0:1787388268.707852:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+7:14932:x1874211953035904:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 208us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.707859:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 116 00000100:00100000:3.0:1787388268.710328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388268.711197:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036032 00000100:00100000:1.0:1787388268.711208:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036032 00000100:00100000:1.0:1787388268.711362:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 117 00000100:00100000:1.0:1787388268.711373:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+7:14932:x1874211953036032:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787388268.711579:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14932:x1874211953036032:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 208us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388268.711606:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 117 00000100:00100000:3.0:1787388268.714269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.714534:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036160 00000100:00100000:2.0:1787388268.714543:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036160 00000100:00100000:2.0:1787388268.714596:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 118 00000100:00100000:2.0:1787388268.714606:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14932:x1874211953036160:12345-192.168.204.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787388268.716694:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14932:x1874211953036160:12345-192.168.204.52@tcp:503:mount.lustre.0 Request processed in 189us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.716718:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 118 00000100:00100000:0.0:1787388268.721150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388268.721473:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036288 00000100:00100000:3.0:1787388268.721484:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036288 00000100:00100000:3.0:1787388268.721538:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 119 00000100:00100000:3.0:1787388268.721548:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14951:x1874211953036288:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388268.722262:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14951:x1874211953036288:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 710us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.722272:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 119 00000100:00100000:0.0:1787388268.755259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.755366:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036416 00000100:00100000:2.0:1787388268.755377:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036416 00000100:00100000:2.0:1787388268.755438:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 120 00000100:00100000:2.0:1787388268.755449:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14951:x1874211953036416:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388268.755778:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14951:x1874211953036416:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 330us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.755787:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 120 00000100:00100000:1.0:1787388268.765636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388268.767722:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036544 00000100:00100000:0.0:1787388268.767737:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036544 00000100:00100000:0.0:1787388268.767818:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 121 00000100:00100000:0.0:1787388268.767828:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14951:x1874211953036544:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388268.768017:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14951:x1874211953036544:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 190us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388268.768026:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 121 00000100:00100000:0.0:1787388268.777234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388268.777337:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036672 00000100:00100000:3.0:1787388268.777347:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036672 00000100:00100000:3.0:1787388268.777499:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 122 00000100:00100000:3.0:1787388268.777510:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cc6f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+8:14932:x1874211953036672:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388268.777527:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388268.777546:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef96e00/0x5cb77467b18130be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd509b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.777576:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96e00/0x5cb77467b18130be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd509b expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.777587:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef96e00/0x5cb77467b18130be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd509b expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.777611:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96e00, rc 0) 00000100:00100000:3.0:1787388268.777722:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cc6f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+9:14932:x1874211953036672:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 214us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.777730:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 122 00000100:00100000:3.0:1787388268.780882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.780982:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036800 00000100:00100000:2.0:1787388268.780993:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036800 00000100:00100000:2.0:1787388268.781046:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 123 00000100:00100000:2.0:1787388268.781056:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d1fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+9:14932:x1874211953036800:12345-192.168.204.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787388268.781080:0:17141:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787388268.781105:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787388268.781113:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787388268.781116:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787388268.781119:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787388268.781121:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787388268.783483:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d1fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+9:14932:x1874211953036800:12345-192.168.204.52@tcp:256:mount.lustre.0 Request processed in 2342us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.783499:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 123 00000100:00100000:1.0:1787388268.789077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388268.789170:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953036928 00000100:00100000:3.0:1787388268.789183:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953036928 00000100:00100000:3.0:1787388268.789248:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 124 00000100:00100000:3.0:1787388268.789258:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d1fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+9:14932:x1874211953036928:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388268.789276:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388268.789293:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd50a2 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.789324:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.789335:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388268.789343:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96600, rc 0) 00000100:00100000:3.0:1787388268.789409:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d1fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14932:x1874211953036928:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 153us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.789416:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 124 00000100:00100000:3.0:1787388268.791914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.792110:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037056 00000100:00100000:2.0:1787388268.792120:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037056 00000100:00100000:2.0:1787388268.792184:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 125 00000100:00100000:2.0:1787388268.792194:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273d1fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14932:x1874211953037056:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787388268.792352:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273d1fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14932:x1874211953037056:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 159us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.792360:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 125 00000100:00100000:1.0:1787388268.794948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388268.795094:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037184 00000100:00100000:0.0:1787388268.795106:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037184 00000100:00100000:0.0:1787388268.795172:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 126 00000100:00100000:0.0:1787388268.795183:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14932:x1874211953037184:12345-192.168.204.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787388268.795331:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14932:x1874211953037184:12345-192.168.204.52@tcp:503:mount.lustre.0 Request processed in 149us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388268.795339:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 126 00000100:00100000:1.0:1787388268.799452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388268.799838:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037312 00000100:00100000:3.0:1787388268.799848:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037312 00000100:00100000:3.0:1787388268.799930:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 127 00000100:00100000:3.0:1787388268.799940:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14956:x1874211953037312:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388268.800096:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14956:x1874211953037312:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 156us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.800105:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 127 00000100:00100000:3.0:1787388268.807004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.807181:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037440 00000100:00100000:2.0:1787388268.807190:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037440 00000100:00100000:2.0:1787388268.807251:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:2.0:1787388268.807262:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14956:x1874211953037440:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388268.807437:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:14956:x1874211953037440:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 176us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.807446:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 128 00000100:00100000:1.0:1787388268.819465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.819577:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037568 00000100:00100000:2.0:1787388268.819590:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037568 00000100:00100000:2.0:1787388268.819647:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:2.0:1787388268.819656:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874211953037568:12345-192.168.204.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787388268.819726:0:17147:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2406629b-ad3b-4a21-a5a1-6f470adb1172@192.168.204.52@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1787388268.819788:0:17147:0:(genops.c:1406:class_connect()) connect: client 2406629b-ad3b-4a21-a5a1-6f470adb1172, cookie 0x5cb77467b18130cc 00000004:00100000:2.0:1787388268.819813:0:17147:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 76 00000100:00080000:2.0:1787388268.820028:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9272c207d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388268.820102:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2400:x1874211953037568:12345-192.168.204.52@tcp:38:mount.lustre.0 Request processed in 445us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.820110:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:1.0:1787388268.822954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.823097:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037824 00000100:00100000:2.0:1787388268.823107:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037824 00000100:00100000:2.0:1787388268.823167:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:2.0:1787388268.823178:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874211953037824:12345-192.168.204.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787388268.823217:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 2406629b-ad3b-4a21-a5a1-6f470adb1172@192.168.204.52@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1787388268.823273:0:17146:0:(genops.c:1406:class_connect()) connect: client 2406629b-ad3b-4a21-a5a1-6f470adb1172, cookie 0x5cb77467b18130d3 00000004:00100000:2.0:1787388268.823296:0:17146:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 76 00000100:00080000:2.0:1787388268.827791:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9272c207f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388268.827881:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2400:x1874211953037824:12345-192.168.204.52@tcp:38:mount.lustre.0 Request processed in 4701us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.827893:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:3.0:1787388268.829001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.829143:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038080 00000100:00100000:2.0:1787388268.829153:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038080 00000100:00100000:2.0:1787388268.829230:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:2.0:1787388268.829240:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038080:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388268.829270:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388268.829346:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038080:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.829353:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00080000:3.0:1787388268.830381:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388268.832991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.833247:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037696 00000100:00100000:2.0:1787388268.833258:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037696 00000100:00100000:2.0:1787388268.833326:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:2.0:1787388268.833339:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2403:x1874211953037696:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388268.833376:0:19482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388268.833456:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2403:x1874211953037696:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 119us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.833464:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:1.0:1787388268.835748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.835908:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953037952 00000100:00100000:2.0:1787388268.835918:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953037952 00000100:00100000:2.0:1787388268.836029:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:2.0:1787388268.836040:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:0:x1874211953037952:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388268.836068:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388268.836187:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:0:x1874211953037952:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 148us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.836196:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00080000:3.0:1787388268.836245:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388268.840175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388268.848852:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038208 00000100:00100000:0.0:1787388268.848869:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038208 00000100:00100000:0.0:1787388268.848935:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:0.0:1787388268.848946:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038208:12345-192.168.204.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787388268.849036:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038208:12345-192.168.204.52@tcp:40:mount.lustre.0 Request processed in 92us (8883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388268.849059:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:1.0:1787388268.852583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388268.852630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388268.852665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388268.852811:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038336 00000100:00100000:2.0:1787388268.852820:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038336 00000100:00100000:2.0:1787388268.852857:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038464 00000100:00100000:2.0:1787388268.852859:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038464 00000100:00100000:2.0:1787388268.852877:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:2.0:1787388268.852895:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1874211953038336:12345-192.168.204.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787388268.852930:0:18651:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2406629b-ad3b-4a21-a5a1-6f470adb1172@192.168.204.52@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1787388268.852983:0:18651:0:(genops.c:1406:class_connect()) connect: client 2406629b-ad3b-4a21-a5a1-6f470adb1172, cookie 0x5cb77467b18130da 00002000:00100000:2.0:1787388268.852995:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2406629b-ad3b-4a21-a5a1-6f470adb1172/ffff9273f4b24000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388268.853012:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 76 00002000:00080000:2.0:1787388268.853365:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388268.853469:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9273f4b23800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388268.853540:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2400:x1874211953038336:12345-192.168.204.52@tcp:8:mount.lustre.0 Request processed in 654us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.853548:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:2.0:1787388268.853570:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:2.0:1787388268.853575:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1874211953038464:12345-192.168.204.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787388268.853593:0:18651:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2406629b-ad3b-4a21-a5a1-6f470adb1172@192.168.204.52@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1787388268.853613:0:18651:0:(genops.c:1406:class_connect()) connect: client 2406629b-ad3b-4a21-a5a1-6f470adb1172, cookie 0x5cb77467b18130e1 00002000:00100000:2.0:1787388268.853619:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2406629b-ad3b-4a21-a5a1-6f470adb1172/ffff9273f4b27000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388268.853828:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 76 00000100:00100000:3.0:1787388268.854039:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038592 00000100:00100000:3.0:1787388268.854045:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038592 00002000:00080000:2.0:1787388268.854351:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787388268.854378:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9273f4b22000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388268.854495:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2400:x1874211953038464:12345-192.168.204.52@tcp:8:mount.lustre.0 Request processed in 918us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.854503:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:3.0:1787388268.854563:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:3.0:1787388268.854572:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038592:12345-192.168.204.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787388268.854606:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038592:12345-192.168.204.52@tcp:900:mount.lustre.0 Request processed in 36us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.854612:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:0.0:1787388268.858024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388268.858237:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038720 00000100:00100000:1.0:1787388268.858246:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038720 00000100:00100000:1.0:1787388268.858305:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:1.0:1787388268.858315:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038720:12345-192.168.204.52@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787388268.865800:0:17149:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7308us 00000004:00200000:2.0:1787388268.874219:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787388268.874640:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14932:x1874211953038720:12345-192.168.204.52@tcp:33:mount.lustre.0 Request processed in 16320us (16619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.874656:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:2.0:1787388269.021090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388269.021172:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038848 00000100:00100000:1.0:1787388269.021183:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038848 00000100:00100000:1.0:1787388269.021259:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:1.0:1787388269.021272:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:14979:x1874211953038848:12345-192.168.204.52@tcp:101:mkdir.0 00010000:00010000:1.0:1787388269.021300:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388269.021330:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b18130e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd50d3 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.021404:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18130ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.021435:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18130ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.021448:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18130ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388269.021506:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388269.021510:0:17148:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388269.021601:0:17148:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18130ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.021775:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b18130e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50d3 expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.021795:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18130ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50d3 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.021804:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:1.0:1787388269.021807:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388269.021811:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021800, rc 0) 00000100:00100000:1.0:1787388269.021985:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:14979:x1874211953038848:12345-192.168.204.52@tcp:101:mkdir.0 Request processed in 716us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.021994:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:3.0:1787388269.064313:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971991296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388269.064389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388269.064431:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971991168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388269.064452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388269.064472:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388269.064478:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971991424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388269.064497:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388269.064614:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991296 00000100:00100000:0.0:1787388269.064630:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991296 00000100:00080000:2.0:1787388269.064695:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388269.064713:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991168 00000100:00100000:0.0:1787388269.064716:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991168 00000100:00100000:0.0:1787388269.064745:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991424 00000100:00100000:0.0:1787388269.064748:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991424 00000100:00080000:2.0:1787388269.064755:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388269.064758:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388269.064766:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388269.064775:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971991296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388269.064797:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787388269.064862:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971991296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388269.064870:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388269.064886:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388269.064892:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971991168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388269.064902:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388269.064912:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971991296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388269.064926:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971991168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388269.064932:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388269.064941:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971991168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388269.064941:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787388269.064947:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971991424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388269.064956:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787388269.064983:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971991424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388269.064989:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388269.064998:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971991424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388269.065315:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971991552:0@lo:400:kworker.0 00000100:00100000:3.0:1787388269.065331:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971991680:0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.065349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388269.065366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388269.065375:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971992064:0@lo:400:kworker.0 00000100:00100000:3.0:1787388269.065380:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971992192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388269.065398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388269.065398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388269.065412:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971992704:0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.065412:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971992576:0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.065431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388269.065437:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971991936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388269.065459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388269.065472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388269.065473:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971992448:0@lo:400:kworker.0 00000100:00100000:3.0:1787388269.065495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388269.065495:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971991808:0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.065514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388269.065604:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971992320:0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.065627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388269.065649:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991680 00000100:00100000:2.0:1787388269.065659:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992192 00000100:00100000:2.0:1787388269.065663:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992192 00000100:00100000:1.0:1787388269.065663:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991680 00000100:00100000:1.0:1787388269.065699:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991936 00000100:00100000:1.0:1787388269.065702:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991936 00000100:00100000:2.0:1787388269.065703:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992576 00000100:00100000:2.0:1787388269.065705:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992576 00000100:00100000:1.0:1787388269.065716:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388269.065721:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992704 00000100:00100000:1.0:1787388269.065722:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971991680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.065723:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992704 00000100:00100000:2.0:1787388269.065734:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992448 00000100:00100000:2.0:1787388269.065736:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992448 00000100:00100000:2.0:1787388269.065747:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991808 00000100:00100000:2.0:1787388269.065749:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991808 00000100:00100000:2.0:1787388269.065759:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992320 00000100:00100000:2.0:1787388269.065761:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992320 00000100:00100000:2.0:1787388269.065774:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787388269.065774:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971991680:12345-0@lo:400:kworker.0 Request processed in 52us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388269.065779:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971992192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.065780:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787388269.065794:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388269.065800:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971991936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.065831:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971991936:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.065837:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388269.066020:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971991680:0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066043:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787388269.066052:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971992576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066088:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874211971992576:12345-0@lo:400:kworker.0 Request processed in 37us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.066094:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787388269.066107:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787388269.066114:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971992704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066143:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971992704:12345-0@lo:400:kworker.0 Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.066149:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787388269.066172:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787388269.066179:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971992448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066204:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874211971992448:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.066210:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787388269.066228:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787388269.066233:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971991808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066265:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211971991808:12345-0@lo:400:kworker.0 Request processed in 32us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.066271:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787388269.066281:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787388269.066287:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971992320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066311:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971992320:12345-0@lo:400:kworker.0 Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.066316:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787388269.066341:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874211971992576:0@lo:400:kworker.0 00010000:00080000:1.0:1787388269.066366:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e44a80 x1874211971992704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388269.066376:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971992704:0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066403:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992064 00000100:00100000:1.0:1787388269.066406:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992064 00000100:00100000:1.0:1787388269.066432:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388269.066438:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971992064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066472:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971992064:12345-0@lo:400:kworker.0 Request processed in 34us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.066478:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787388269.066491:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388269.066494:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388269.066496:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388269.066511:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971992064:0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066552:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211971991808:0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.066562:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971992320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388269.066797:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971991936:0@lo:400:kworker.0 00010000:00080000:3.0:1787388269.066809:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c3e44700 x1874211971992448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388269.066818:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874211971992448:0@lo:400:kworker.0 00000100:00100000:2.0:1787388269.066995:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971992192:12345-0@lo:400:kworker.0 Request processed in 1214us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388269.067002:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787388269.067366:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971991552 00000100:00100000:0.0:1787388269.067372:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971991552 00000100:00100000:0.0:1787388269.067414:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787388269.067421:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3646:x1874211971991552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388269.067469:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3646:x1874211971991552:12345-0@lo:400:kworker.0 Request processed in 48us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388269.067475:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787388269.068817:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971991552:0@lo:400:kworker.0 00000100:00100000:1.0:1787388269.069333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971992192:0@lo:400:kworker.0 00010000:00010000:2.0:1787388269.127873:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787388270.094418:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2406629b-ad3b-4a21-a5a1-6f470adb1172 00000001:00100000:2.0:1787388270.095156:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2406629b-ad3b-4a21-a5a1-6f470adb1172 00010000:00010000:0.0:1787388270.153186:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388271.038053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.038505:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953038976 00000100:00100000:2.0:1787388271.038516:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953038976 00000100:00100000:2.0:1787388271.039047:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:2.0:1787388271.039058:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15032:x1874211953038976:12345-192.168.204.52@tcp:41:lfs.0 00000004:00000024:2.0:1787388271.039101:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388271.039208:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15032:x1874211953038976:12345-192.168.204.52@tcp:41:lfs.0 Request processed in 151us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.039216:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00080000:1.0:1787388271.039272:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388271.045555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.045658:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039104 00000100:00100000:2.0:1787388271.045668:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039104 00000100:00100000:2.0:1787388271.045822:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:2.0:1787388271.045833:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:15032:x1874211953039104:12345-192.168.204.52@tcp:41:lfs.0 00000004:00000024:2.0:1787388271.045870:0:19482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388271.045956:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:15032:x1874211953039104:12345-192.168.204.52@tcp:41:lfs.0 Request processed in 126us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.045963:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00080000:1.0:1787388271.046811:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388271.050533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.050890:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039232 00000100:00100000:3.0:1787388271.050899:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039232 00000100:00100000:3.0:1787388271.050974:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:3.0:1787388271.050985:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15032:x1874211953039232:12345-192.168.204.52@tcp:13:lfs.0 00002000:00000024:3.0:1787388271.051193:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388271.051285:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15032:x1874211953039232:12345-192.168.204.52@tcp:13:lfs.0 Request processed in 301us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.051293:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00080000:1.0:1787388271.051424:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388271.059041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.059346:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039360 00000100:00100000:0.0:1787388271.059357:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039360 00000100:00100000:0.0:1787388271.059435:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:0.0:1787388271.059447:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15032:x1874211953039360:12345-192.168.204.52@tcp:13:lfs.0 00002000:00000024:0.0:1787388271.059481:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787388271.059573:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15032:x1874211953039360:12345-192.168.204.52@tcp:13:lfs.0 Request processed in 128us (542us total) trans 0 rc 0/0 00000100:00080000:1.0:1787388271.059672:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388271.060351:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00010000:00010000:2.0:1787388271.175860:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388271.232516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.232792:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039488 00000100:00100000:3.0:1787388271.232814:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039488 00000100:00100000:3.0:1787388271.232871:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 130 00000100:00100000:3.0:1787388271.232882:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+10:15064:x1874211953039488:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388271.232899:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388271.232917:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef96c00/0x5cb77467b18130f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd50da expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.233020:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96c00/0x5cb77467b18130f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50da expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.233033:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef96c00/0x5cb77467b18130f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50da expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.233043:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96c00, rc 0) 00000100:00100000:3.0:1787388271.233291:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15064:x1874211953039488:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 409us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.233299:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 130 00000100:00100000:3.0:1787388271.237717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.238045:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039616 00000100:00100000:0.0:1787388271.238056:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039616 00000100:00100000:0.0:1787388271.238191:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 131 00000100:00100000:0.0:1787388271.238203:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15064:x1874211953039616:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787388271.238401:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15064:x1874211953039616:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 200us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.238410:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 131 00000100:00100000:1.0:1787388271.243833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.246921:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039744 00000100:00100000:3.0:1787388271.246937:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039744 00000100:00100000:3.0:1787388271.247013:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 132 00000100:00100000:3.0:1787388271.247023:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15064:x1874211953039744:12345-192.168.204.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787388271.247188:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15064:x1874211953039744:12345-192.168.204.52@tcp:503:mount.lustre.0 Request processed in 165us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.247196:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 132 00000100:00100000:1.0:1787388271.256787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.256889:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953039872 00000100:00100000:0.0:1787388271.256911:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953039872 00000100:00100000:0.0:1787388271.256972:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 133 00000100:00100000:0.0:1787388271.256983:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15071:x1874211953039872:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388271.257155:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15071:x1874211953039872:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 173us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.257164:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 133 00000100:00100000:0.0:1787388271.283800:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.284242:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040000 00000100:00100000:2.0:1787388271.284254:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040000 00000100:00100000:2.0:1787388271.284320:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 134 00000100:00100000:2.0:1787388271.284331:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c36f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15071:x1874211953040000:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388271.284494:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c36f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15071:x1874211953040000:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 163us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.284503:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 134 00000100:00100000:1.0:1787388271.287541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.290966:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040128 00000100:00100000:3.0:1787388271.290982:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040128 00000100:00100000:3.0:1787388271.291066:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:3.0:1787388271.291077:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15071:x1874211953040128:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388271.291371:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15071:x1874211953040128:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 294us (3840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.291380:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 135 00000100:00100000:1.0:1787388271.296339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.296777:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040256 00000100:00100000:0.0:1787388271.296789:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040256 00000100:00100000:0.0:1787388271.296966:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:0.0:1787388271.296978:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:15064:x1874211953040256:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787388271.296996:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388271.297014:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1497400/0x5cb77467b18130fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd510b expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.297042:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1497400/0x5cb77467b18130fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd510b expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.297053:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1497400/0x5cb77467b18130fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd510b expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.297063:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497400, rc 0) 00000100:00100000:0.0:1787388271.297132:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:15064:x1874211953040256:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 155us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.297139:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 136 00000100:00100000:3.0:1787388271.300008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.301081:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040384 00000100:00100000:2.0:1787388271.301094:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040384 00000100:00100000:2.0:1787388271.301152:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 137 00000100:00100000:2.0:1787388271.301162:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:15064:x1874211953040384:12345-192.168.204.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787388271.301212:0:17141:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787388271.301231:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787388271.301235:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787388271.301238:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787388271.301241:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787388271.301243:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787388271.304217:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:15064:x1874211953040384:12345-192.168.204.52@tcp:256:mount.lustre.0 Request processed in 3046us (4207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.304232:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 137 00000100:00100000:3.0:1787388271.312775:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.313615:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040512 00000100:00100000:0.0:1787388271.313626:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040512 00000100:00100000:0.0:1787388271.313768:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 138 00000100:00100000:0.0:1787388271.313784:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:15064:x1874211953040512:12345-192.168.204.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787388271.313809:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388271.313835:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5112 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.313888:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.313907:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.313922:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497200, rc 0) 00000100:00100000:0.0:1787388271.314000:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15064:x1874211953040512:12345-192.168.204.52@tcp:101:mount.lustre.0 Request processed in 223us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.314007:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 138 00000100:00100000:3.0:1787388271.317034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.317188:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040640 00000100:00100000:2.0:1787388271.317198:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040640 00000100:00100000:2.0:1787388271.317308:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 139 00000100:00100000:2.0:1787388271.317319:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15064:x1874211953040640:12345-192.168.204.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787388271.317476:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15064:x1874211953040640:12345-192.168.204.52@tcp:501:mount.lustre.0 Request processed in 159us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.317484:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 139 00000100:00100000:3.0:1787388271.320390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388271.320475:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040768 00000100:00100000:1.0:1787388271.320788:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040768 00000100:00100000:0.0:1787388271.320940:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 140 00000100:00100000:0.0:1787388271.321051:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15064:x1874211953040768:12345-192.168.204.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787388271.321303:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15064:x1874211953040768:12345-192.168.204.52@tcp:503:mount.lustre.0 Request processed in 353us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.321312:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 140 00000100:00100000:3.0:1787388271.323567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.323781:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953040896 00000100:00100000:2.0:1787388271.323791:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953040896 00000100:00100000:2.0:1787388271.324264:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 141 00000100:00100000:2.0:1787388271.324301:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15077:x1874211953040896:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388271.324448:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15077:x1874211953040896:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 149us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.324455:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 141 00000100:00100000:3.0:1787388271.328170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.328270:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041024 00000100:00100000:0.0:1787388271.328293:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041024 00000100:00100000:0.0:1787388271.328353:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 142 00000100:00100000:0.0:1787388271.328364:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15077:x1874211953041024:12345-192.168.204.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388271.328536:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:15077:x1874211953041024:12345-192.168.204.52@tcp:502:llog_process_th.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.328551:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 142 00000100:00100000:3.0:1787388271.339261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.339309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.339342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.339362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.339377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.339396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.340401:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041792 00000100:00100000:0.0:1787388271.340412:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041792 00000100:00100000:0.0:1787388271.340456:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041920 00000100:00100000:0.0:1787388271.340459:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041920 00000100:00100000:0.0:1787388271.340468:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041152 00000100:00100000:0.0:1787388271.340470:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041152 00000100:00100000:0.0:1787388271.340478:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041408 00000100:00100000:0.0:1787388271.340479:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041408 00000100:00100000:0.0:1787388271.340491:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:0.0:1787388271.340500:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2401:x1874211953041792:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388271.340627:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2401:x1874211953041792:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 127us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.340635:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:0.0:1787388271.340651:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:0.0:1787388271.340657:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2401:x1874211953041920:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388271.340701:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2401:x1874211953041920:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 22us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.340707:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:0.0:1787388271.340718:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:0.0:1787388271.340722:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874211953041152:12345-192.168.204.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787388271.340740:0:17146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2623ffb6-be20-4c97-8a38-48065ab9eab6@192.168.204.52@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1787388271.340773:0:17146:0:(genops.c:1406:class_connect()) connect: client 2623ffb6-be20-4c97-8a38-48065ab9eab6, cookie 0x5cb77467b181310b 00000100:00100000:2.0:1787388271.341016:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042048 00000100:00100000:2.0:1787388271.341021:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042048 00000100:00100000:2.0:1787388271.341061:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042176 00000100:00100000:2.0:1787388271.341064:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042176 00000100:00100000:2.0:1787388271.341085:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:2.0:1787388271.341092:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953042048:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388271.341144:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953042048:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 54us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.341151:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:2.0:1787388271.341164:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:2.0:1787388271.341171:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953042176:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388271.341192:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953042176:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 22us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.341198:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:2.0:1787388271.341217:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:2.0:1787388271.341222:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874211953041408:12345-192.168.204.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787388271.341237:0:19482:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 2623ffb6-be20-4c97-8a38-48065ab9eab6@192.168.204.52@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:2.0:1787388271.341264:0:19482:0:(genops.c:1406:class_connect()) connect: client 2623ffb6-be20-4c97-8a38-48065ab9eab6, cookie 0x5cb77467b1813112 00000004:00100000:2.0:1787388271.341289:0:19482:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 76 00000100:00080000:2.0:1787388271.341377:0:19482:0:(import.c:65:import_set_state_nolock()) ffff9273f4b24800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388271.341422:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2400:x1874211953041408:12345-192.168.204.52@tcp:38:mount.lustre.0 Request processed in 198us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.341429:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000004:00100000:0.0:1787388271.341969:0:17146:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 76 00000100:00080000:0.0:1787388271.342031:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9272c2cbc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388271.342643:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2400:x1874211953041152:12345-192.168.204.52@tcp:38:mount.lustre.0 Request processed in 1918us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.342653:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:3.0:1787388271.358018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.359627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.359928:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041536 00000100:00100000:2.0:1787388271.359938:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041536 00000100:00100000:2.0:1787388271.359998:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041280 00000100:00100000:2.0:1787388271.360002:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041280 00000100:00100000:2.0:1787388271.360032:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00080000:1.0:1787388271.360150:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388271.360154:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388271.360187:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787388271.360202:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:0:x1874211953041280:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787388271.360236:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388271.360308:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:0:x1874211953041280:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 112us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388271.360316:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:3.0:1787388271.360636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.360775:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953041664 00000100:00100000:3.0:1787388271.360782:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953041664 00000100:00100000:2.0:1787388271.360784:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:0:x1874211953041536:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388271.360805:0:19482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388271.360814:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:3.0:1787388271.360824:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953041664:12345-192.168.204.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787388271.360840:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388271.360849:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:0:x1874211953041536:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 70us (2839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.360857:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:3.0:1787388271.360877:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953041664:12345-192.168.204.52@tcp:41:mount.lustre.0 Request processed in 54us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.360900:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787388271.368394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.368599:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042304 00000100:00100000:2.0:1787388271.368814:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042304 00000100:00100000:2.0:1787388271.368878:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:2.0:1787388271.368888:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953042304:12345-192.168.204.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787388271.368977:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953042304:12345-192.168.204.52@tcp:40:mount.lustre.0 Request processed in 90us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.368984:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:1.0:1787388271.371000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.371205:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042688 00000100:00100000:0.0:1787388271.371214:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042688 00000100:00100000:0.0:1787388271.371269:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:0.0:1787388271.371280:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953042688:12345-192.168.204.52@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787388271.371360:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953042688:12345-192.168.204.52@tcp:900:mount.lustre.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.371367:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:0.0:1787388271.371645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388271.371991:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042432 00000100:00100000:2.0:1787388271.371997:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042432 00000100:00100000:2.0:1787388271.372029:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:2.0:1787388271.372034:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874211953042432:12345-192.168.204.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787388271.372256:0:18653:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2623ffb6-be20-4c97-8a38-48065ab9eab6@192.168.204.52@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:2.0:1787388271.372298:0:18653:0:(genops.c:1406:class_connect()) connect: client 2623ffb6-be20-4c97-8a38-48065ab9eab6, cookie 0x5cb77467b1813119 00002000:00100000:2.0:1787388271.372316:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2623ffb6-be20-4c97-8a38-48065ab9eab6/ffff9273f4b26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388271.372326:0:18653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 76 00002000:00080000:2.0:1787388271.372463:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388271.372494:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9273f4b21000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388271.372541:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2400:x1874211953042432:12345-192.168.204.52@tcp:8:mount.lustre.0 Request processed in 506us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.372550:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:3.0:1787388271.372597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388271.372957:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042560 00000100:00100000:0.0:1787388271.372962:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042560 00000100:00100000:0.0:1787388271.372992:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:0.0:1787388271.372998:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874211953042560:12345-192.168.204.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787388271.373019:0:18652:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2623ffb6-be20-4c97-8a38-48065ab9eab6@192.168.204.52@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1787388271.373045:0:18652:0:(genops.c:1406:class_connect()) connect: client 2623ffb6-be20-4c97-8a38-48065ab9eab6, cookie 0x5cb77467b1813120 00002000:00100000:0.0:1787388271.373051:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2623ffb6-be20-4c97-8a38-48065ab9eab6/ffff9272c2cbf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787388271.373058:0:18652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 76 00002000:00080000:0.0:1787388271.373119:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787388271.373135:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9272c2cbf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388271.373171:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2400:x1874211953042560:12345-192.168.204.52@tcp:8:mount.lustre.0 Request processed in 173us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.373178:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:1.0:1787388271.376920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388271.377250:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042816 00000100:00100000:3.0:1787388271.377259:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042816 00000100:00100000:3.0:1787388271.377364:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:3.0:1787388271.377374:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953042816:12345-192.168.204.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787388271.377459:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787388271.377543:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15064:x1874211953042816:12345-192.168.204.52@tcp:33:mount.lustre.0 Request processed in 169us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.377550:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 1 00000040:00080000:1.0:1787388271.496437:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388271.523393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388271.523536:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953042944 00000100:00100000:1.0:1787388271.523547:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953042944 00000100:00100000:1.0:1787388271.523644:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:1.0:1787388271.523655:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15100:x1874211953042944:12345-192.168.204.52@tcp:101:mkdir.0 00010000:00010000:1.0:1787388271.523676:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388271.523719:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5143 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.523787:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.523801:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.523813:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388271.523857:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388271.523861:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388271.523879:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.523905:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.523924:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.523952:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:1.0:1787388271.523955:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388271.523959:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020200, rc 0) 00000100:00100000:1.0:1787388271.524017:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+7:15100:x1874211953042944:12345-192.168.204.52@tcp:101:mkdir.0 Request processed in 364us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388271.524025:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:1.0:1787388271.623936:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971992832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388271.624013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388271.627308:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992832 00000100:00100000:2.0:1787388271.627323:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992832 00000100:00100000:2.0:1787388271.627410:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388271.627421:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971992832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388271.627445:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388271.627538:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971992832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.627546:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388271.627730:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971992832:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787388271.627929:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787388272.201441:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388273.160033:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971992960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388273.160126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388273.160301:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971992960 00000100:00100000:1.0:1787388273.160311:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971992960 00000100:00100000:1.0:1787388273.160382:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388273.160393:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971992960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388273.160428:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388273.160483:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971992960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388273.160490:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787388273.160766:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971992960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388273.161500:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971993088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388273.161544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388273.161638:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993088 00000100:00100000:1.0:1787388273.161644:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993088 00000100:00100000:1.0:1787388273.161720:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388273.161728:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971993088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388273.161754:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787388273.161801:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971993088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388273.161833:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787388273.161845:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971993088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388273.224300:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787388273.976466:0:20025:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:0.0:1787388274.122647:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388274.184038:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971993344:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.184175:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971993856:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.184215:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971994368:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.184263:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787388274.184269:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971993472:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.184310:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971993984:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.184367:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971994496:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184388:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.184421:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993344 00000100:00100000:3.0:1787388274.184429:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993344 00000100:00100000:3.0:1787388274.184469:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993856 00000100:00100000:3.0:1787388274.184471:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993856 00000100:00100000:3.0:1787388274.184489:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787388274.184498:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971993344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184585:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971993344:12345-0@lo:400:kworker.0 Request processed in 88us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.184594:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787388274.184612:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388274.184618:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184648:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971993856:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.184653:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388274.184705:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993472 00000100:00100000:3.0:1787388274.184709:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993472 00000100:00100000:3.0:1787388274.184743:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993984 00000100:00100000:3.0:1787388274.184747:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993984 00000100:00100000:3.0:1787388274.184764:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787388274.184770:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971993472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184801:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971993472:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.184807:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787388274.184819:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787388274.184832:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971993984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184878:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971993984:12345-0@lo:400:kworker.0 Request processed in 46us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.184885:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787388274.184912:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994368 00000100:00100000:3.0:1787388274.184915:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994368 00000100:00100000:3.0:1787388274.184939:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994496 00000100:00100000:3.0:1787388274.184942:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994496 00000100:00100000:3.0:1787388274.184960:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787388274.184967:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971994368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.184997:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874211971994368:12345-0@lo:400:kworker.0 Request processed in 30us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.185003:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787388274.185016:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787388274.185021:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971994496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.185048:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874211971994496:12345-0@lo:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.185066:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787388274.185082:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388274.185086:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388274.185088:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388274.185127:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971993472:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.185138:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971993984:0@lo:400:kworker.0 00010000:00080000:3.0:1787388274.185150:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c209f100 x1874211971994496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388274.185160:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874211971994496:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.185182:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971993344:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.185191:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971993856:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.185200:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874211971994368:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185425:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971993216:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185513:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971993728:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185569:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971994240:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185608:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971994752:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185642:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388274.185648:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971993600:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971994112:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185746:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971994624:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388274.185785:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993728 00000100:00100000:1.0:1787388274.185789:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993728 00000100:00100000:1.0:1787388274.185812:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994240 00000100:00100000:1.0:1787388274.185815:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994240 00000100:00100000:1.0:1787388274.185825:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994752 00000100:00100000:1.0:1787388274.185827:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994752 00000100:00100000:1.0:1787388274.185848:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994624 00000100:00100000:1.0:1787388274.185850:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994624 00000100:00100000:1.0:1787388274.185864:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388274.185870:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971993728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185921:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874211971993728:12345-0@lo:400:kworker.0 Request processed in 51us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388274.185927:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388274.185941:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388274.185948:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971994240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.185972:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874211971994240:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388274.185977:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388274.185989:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388274.185995:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971994752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186019:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874211971994752:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388274.186025:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787388274.186035:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388274.186040:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971994624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186078:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874211971994624:12345-0@lo:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388274.186084:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388274.186102:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993600 00000100:00100000:1.0:1787388274.186105:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993600 00000100:00100000:1.0:1787388274.186131:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994112 00000100:00100000:1.0:1787388274.186134:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994112 00000100:00100000:1.0:1787388274.186149:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388274.186155:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971993600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186185:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211971993600:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388274.186200:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388274.186211:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787388274.186217:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971994112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186244:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971994112:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388274.186250:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787388274.186270:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388274.186274:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388274.186276:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388274.186308:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211971993600:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186318:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971994112:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186328:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874211971994624:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186338:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874211971993728:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.186347:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874211971994240:0@lo:400:kworker.0 00010000:00080000:1.0:1787388274.186356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9272c209dc00 x1874211971994752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388274.186366:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874211971994752:0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.186650:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971993216 00000100:00100000:3.0:1787388274.186656:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971993216 00000100:00100000:3.0:1787388274.186716:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787388274.186722:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3647:x1874211971993216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388274.186760:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3647:x1874211971993216:12345-0@lo:400:kworker.0 Request processed in 39us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.186766:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787388274.186891:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971993216:0@lo:400:kworker.0 00000100:00100000:1.0:1787388274.187375:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388274.187386:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971994880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388274.187419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388274.187496:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971994880 00000100:00100000:2.0:1787388274.187500:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971994880 00000100:00100000:2.0:1787388274.187546:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388274.187562:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971994880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388274.187582:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388274.187621:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971994880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388274.187627:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388274.187659:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971994880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388274.188272:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388274.188284:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971995008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388274.188316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.188399:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971995008 00000100:00100000:3.0:1787388274.188405:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971995008 00000100:00100000:3.0:1787388274.188440:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787388274.188448:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971995008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388274.188466:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388274.188501:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971995008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.188507:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787388274.188654:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971995008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388274.189027:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971995136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388274.189071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388274.189128:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971995136 00000100:00100000:3.0:1787388274.189132:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971995136 00000100:00100000:3.0:1787388274.189166:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787388274.189172:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971995136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388274.189183:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388274.189319:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971995136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388274.189337:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787388274.189394:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971995136:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787388274.247917:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787388275.215422:0:17126:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2623ffb6-be20-4c97-8a38-48065ab9eab6 00000001:00100000:1.0:1787388275.215435:0:17126:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2406629b-ad3b-4a21-a5a1-6f470adb1172 00000001:00100000:2.0:1787388275.224158:0:17879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2623ffb6-be20-4c97-8a38-48065ab9eab6 00000001:00100000:2.0:1787388275.224174:0:17879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2406629b-ad3b-4a21-a5a1-6f470adb1172 00010000:00010000:2.0:1787388275.276394:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388276.297362:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388276.565199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565235:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565252:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565314:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565328:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.565392:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043200 00000100:00100000:1.0:1787388276.565403:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043200 00000100:00100000:1.0:1787388276.565453:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043328 00000100:00100000:1.0:1787388276.565456:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043328 00000100:00100000:1.0:1787388276.565468:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043712 00000100:00100000:1.0:1787388276.565471:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043712 00000100:00100000:1.0:1787388276.565484:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043840 00000100:00100000:1.0:1787388276.565487:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043840 00000100:00100000:1.0:1787388276.565504:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:1.0:1787388276.565513:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2402:x1874211953043200:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.565597:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2402:x1874211953043200:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 84us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.565605:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:1.0:1787388276.566821:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:1.0:1787388276.566836:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953043328:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.566901:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953043328:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 73us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.566909:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:1.0:1787388276.566921:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:1.0:1787388276.566928:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2402:x1874211953043712:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.567266:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2402:x1874211953043712:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 336us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.567274:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:1.0:1787388276.567289:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:1.0:1787388276.567298:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2401:x1874211953043840:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.567335:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2401:x1874211953043840:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 40us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.567341:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:1.0:1787388276.567373:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043456 00000100:00100000:1.0:1787388276.567380:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043456 00000100:00100000:1.0:1787388276.567426:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043584 00000100:00100000:1.0:1787388276.567430:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043584 00000100:00100000:3.0:1787388276.567434:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043968 00000100:00100000:3.0:1787388276.567441:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043968 00000100:00100000:1.0:1787388276.567449:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044096 00000100:00100000:1.0:1787388276.567454:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044096 00000100:00100000:0.0:1787388276.567879:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953043072 00000100:00100000:0.0:1787388276.567885:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953043072 00000100:00100000:0.0:1787388276.567922:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 144 00000100:00100000:0.0:1787388276.567931:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:2401:x1874211953043072:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388276.567970:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:2401:x1874211953043072:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 40us (2785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388276.567978:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 144 00000100:00100000:1.0:1787388276.568567:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:1.0:1787388276.568579:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953043456:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.568891:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953043456:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 314us (3615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.568898:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:1.0:1787388276.568915:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:1.0:1787388276.568932:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953043584:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.569129:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2401:x1874211953043584:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 198us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.569136:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:1.0:1787388276.569148:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:1.0:1787388276.569156:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2402:x1874211953043968:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.569184:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2402:x1874211953043968:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 29us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.569189:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:1.0:1787388276.569202:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00100000:1.0:1787388276.569209:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2401:x1874211953044096:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:1.0:1787388276.569228:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2401:x1874211953044096:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 21us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.569234:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 12 00000100:00080000:1.0:1787388276.569254:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388276.569259:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388276.569262:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388276.569264:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388276.745051:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388276.745078:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971995264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388276.745148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388276.745390:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971995264 00000100:00100000:1.0:1787388276.745400:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971995264 00000100:00100000:1.0:1787388276.745465:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388276.745474:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971995264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388276.745504:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787388276.745551:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971995264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.745568:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388276.745618:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971995264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787388276.746039:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787388276.749985:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2623ffb6-be20-4c97-8a38-48065ab9eab6 00000001:00100000:1.0:1787388276.750985:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2623ffb6-be20-4c97-8a38-48065ab9eab6 00000020:00000080:2.0:1787388276.941491:0:20173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd0fc16f90 00000020:00000080:2.0:1787388276.941507:0:20173:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787388276.941513:0:20173:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787388276.941520:0:20173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0fc19220 20000000:00000080:2.0:1787388276.941528:0:20173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9273f4b64c00 uarg=0000000000000000 20000000:01000000:2.0:1787388276.941573:0:20173:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787388276.941579:0:20173:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787388276.941583:0:20173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787388276.942237:0:20174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787388276.942412:0:20173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787388276.949796:0:20173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787388276.949828:0:20173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949848:0:20173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949855:0:20173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949862:0:20173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949869:0:20173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949878:0:20173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949907:0:20173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949914:0:20173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949957:0:20173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.949972:0:20173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 12 pid: 17138 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.949988:0:20173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995392:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388276.951154:0:20173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951167:0:20173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 12 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.951179:0:20173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995520:192.168.204.52@tcp:104: 00010000:00010000:2.0:1787388276.951212:0:20173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951221:0:20173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 23 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.951231:0:20173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c34bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995648:0@lo:104: 00000100:00100000:2.0:1787388276.951270:0:20173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388276.951321:0:20173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951330:0:20173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 23 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.951339:0:20173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995776:0@lo:104: 00000100:00100000:2.0:1787388276.951360:0:20173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388276.951387:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971995648 00000100:00100000:2.0:1787388276.951395:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971995648 00000100:00100000:2.0:1787388276.951450:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971995776 00000100:00100000:2.0:1787388276.951453:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971995776 00000100:00100000:2.0:1787388276.951469:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388276.951476:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:20173:x1874211971995648:12345-0@lo:104: 00010000:00010000:2.0:1787388276.951490:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951543:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388276.951549:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:20173:x1874211971995648:12345-0@lo:104: Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388276.951555:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388276.951571:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388276.951577:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:20173:x1874211971995776:12345-0@lo:104: 00010000:00010000:2.0:1787388276.951596:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951918:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388276.951925:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:20173:x1874211971995776:12345-0@lo:104: Request processed in 348us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388276.951944:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787388276.951966:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388276.951973:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951981:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709000 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388276.951985:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.951993:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388276.952011:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388276.952017:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787388276.952044:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388276.952196:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388276.952199:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388276.952201:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388276.952237:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.952244:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388276.952327:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.952335:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709200 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:1.0:1787388276.952338:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.952345:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388276.952352:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388276.952357:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787388276.952376:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.952382:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787388276.952730:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971995904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388276.952769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388276.952839:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.952846:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c3709000/0x5cb77467b1812eaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812eb1 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.952857:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388276.952859:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388276.952861:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388276.952884:0:20173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.952901:0:20173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 23 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.952911:0:20173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971996160:0@lo:104: 00000100:00100000:2.0:1787388276.952935:0:20173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388276.952960:0:20173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.952968:0:20173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 23 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.952977:0:20173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971996288:0@lo:104: 00000100:00100000:2.0:1787388276.952995:0:20173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388276.953435:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996160 00000100:00100000:2.0:1787388276.953441:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996160 00000100:00100000:2.0:1787388276.953480:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996288 00000100:00100000:2.0:1787388276.953483:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996288 00000100:00100000:2.0:1787388276.953498:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388276.953506:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:20173:x1874211971996160:12345-0@lo:104: 00010000:00010000:2.0:1787388276.953515:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953560:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388276.953565:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+4:20173:x1874211971996160:12345-0@lo:104: Request processed in 61us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388276.953572:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388276.953598:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388276.953605:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:20173:x1874211971996288:12345-0@lo:104: 00010000:00010000:2.0:1787388276.953620:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953653:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388276.953658:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+3:20173:x1874211971996288:12345-0@lo:104: Request processed in 54us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388276.953664:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787388276.953808:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388276.953814:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953821:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c23ff400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388276.953824:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953831:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388276.953838:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388276.953844:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388276.953863:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953869:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388276.953888:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953895:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c23ff400/0x5cb77467b1812dd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dd8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953909:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388276.953912:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953918:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709400 already unused, calling callback (ffffffffc1250c20) 10000000:00010000:2.0:1787388276.953920:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953927:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388276.953933:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388276.953937:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388276.953950:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953957:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388276.953962:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953969:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c3709400/0x5cb77467b1812dc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812dca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.953977:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388276.953979:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388276.953980:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388276.953983:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388276.953990:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971996544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388276.953991:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.152@tcp lock: ffff9272c3709200/0x5cb77467b1812e10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5cb77467b1812e17 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954014:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388276.954020:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388276.954022:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388276.954037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388276.954041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971996032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388276.954076:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971996416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388276.954096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388276.954105:0:20173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388276.954119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388276.954124:0:20173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995648:0@lo:104: 00000100:00100000:2.0:1787388276.954134:0:20173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995776:0@lo:104: 00000100:00100000:1.0:1787388276.954139:0:19484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971995904 00000100:00100000:2.0:1787388276.954141:0:20173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971996160:0@lo:104: 00000100:00100000:1.0:1787388276.954142:0:19484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971995904 00000100:00100000:2.0:1787388276.954147:0:20173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971996288:0@lo:104: 00010000:00010000:1.0:1787388276.954160:0:19484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 24 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388276.954174:0:19484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996544 00000100:00100000:1.0:1787388276.954177:0:19484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996544 00010000:00010000:1.0:1787388276.954187:0:19484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388276.954196:0:19484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996416 00000100:00100000:1.0:1787388276.954199:0:19484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996416 00010000:00010000:1.0:1787388276.954208:0:19484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 26 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388276.954216:0:19484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996032 00000100:00100000:1.0:1787388276.954218:0:19484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996032 00010000:00010000:1.0:1787388276.954226:0:19484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 27 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388276.954236:0:19484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787388276.954243:0:19484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3be7e40-7086-4e4f-aad1-8d3798e099a7+27:3644:x1874211971995904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388276.954253:0:19484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388276.954258:0:19484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 27 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954274:0:19484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 27 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954286:0:19484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fe800/0x5cb77467b1812eb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812eaa expref: 27 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954298:0:19484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388276.954324:0:19484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3be7e40-7086-4e4f-aad1-8d3798e099a7+26:3644:x1874211971995904:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.954330:0:19484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787388276.954344:0:19484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388276.954351:0:19484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3be7e40-7086-4e4f-aad1-8d3798e099a7+25:3647:x1874211971996544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388276.954358:0:19484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388276.954363:0:19484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954370:0:19484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954380:0:19484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c23fee00/0x5cb77467b1812dca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812dc3 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388276.954388:0:19484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388276.954562:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787388276.954571:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3646:x1874211971996416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388276.954586:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388276.954591:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 24 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.954599:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 24 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.954608:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273eef96400/0x5cb77467b1812dd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812dd1 expref: 24 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.954617:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388276.954648:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:3646:x1874211971996416:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388276.954654:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787388276.954668:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787388276.954674:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:3645:x1874211971996032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388276.954703:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388276.954707:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.954715:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.954725:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c3708000/0x5cb77467b1812e17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5cb77467b1812e10 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.954792:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388276.954822:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:3645:x1874211971996032:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388276.954838:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787388276.954956:0:19484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:3647:x1874211971996544:12345-0@lo:103:ldlm_bl.0 Request processed in 606us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388276.954964:0:19484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388276.955357:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211971996544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388276.955429:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3646:1874211971996416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388276.955453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971996032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388276.955746:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388276.956057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388276.956157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388276.956215:0:20173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995392:192.168.204.52@tcp:104: 00000100:00100000:2.0:1787388276.956226:0:20173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c34bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20173:1874211971995520:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388276.956247:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3644:1874211971995904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388276.956262:0:20173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388276.957831:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044224 00000100:00100000:3.0:1787388276.957843:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044224 00010000:00010000:3.0:1787388276.957882:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 13 pid: 17138 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388276.957918:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044352 00000100:00100000:3.0:1787388276.957921:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044352 00010000:00010000:3.0:1787388276.957932:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 14 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388276.957957:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 13 00000100:00100000:3.0:1787388276.957965:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:952f6066-6f96-4bdc-ad92-884b088ec3d7+14:2403:x1874211953044224:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388276.957979:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388276.957985:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 14 pid: 17138 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388276.957985:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 14 00000100:00100000:0.0:1787388276.957993:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:952f6066-6f96-4bdc-ad92-884b088ec3d7+14:2404:x1874211953044352:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388276.957997:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 14 pid: 17138 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958011:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388276.958016:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 14 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388276.958065:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273c1497200/0x5cb77467b1813104 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5112 expref: 14 pid: 17138 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958301:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 13 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388276.958313:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388276.958318:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9273eef96600/0x5cb77467b18130c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50a2 expref: 13 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958331:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958339:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958354:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958360:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958374:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958380:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958387:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:0.0:1787388276.958391:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388276.958400:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388276.958405:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:2403:x1874211953044224:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 441us (2351us total) trans 0 rc 0/0 00010000:00010000:0.0:1787388276.958420:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388276.958422:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 13 00010000:00010000:0.0:1787388276.958431:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388276.958451:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:2404:x1874211953044352:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 459us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388276.958457:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 14 00010000:00010000:2.0:1787388276.958766:0:20173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.958774:0:20173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388276.958780:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9272c3709c00/0x5cb77467b1813135 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388277.321255:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388278.235462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388278.235847:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044480 00000100:00100000:0.0:1787388278.235860:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044480 00000100:00100000:0.0:1787388278.236000:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:0.0:1787388278.236012:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+11:14946:x1874211953044480:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388278.236029:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388278.236053:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273c1497a00/0x5cb77467b181313c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd514a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388278.236087:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273c1497a00/0x5cb77467b181313c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd514a expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388278.236111:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273c1497a00/0x5cb77467b181313c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd514a expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388278.236121:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497a00, rc 0) 00000100:00100000:0.0:1787388278.236186:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:14946:x1874211953044480:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 177us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388278.236194:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 145 00000100:00100000:1.0:1787388278.238861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388278.238927:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044608 00000100:00100000:3.0:1787388278.238937:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044608 00000100:00100000:3.0:1787388278.238997:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00100000:3.0:1787388278.239009:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:14946:x1874211953044608:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.239192:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:14946:x1874211953044608:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 184us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388278.239200:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 146 00000100:00100000:2.0:1787388278.246654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388278.248504:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044736 00000100:00100000:0.0:1787388278.248517:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044736 00000100:00100000:0.0:1787388278.248611:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 147 00000100:00100000:0.0:1787388278.248624:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:14946:x1874211953044736:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388278.248801:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:14946:x1874211953044736:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 178us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388278.248810:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 147 00000100:00100000:0.0:1787388278.260269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388278.260417:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044864 00000100:00100000:3.0:1787388278.260428:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044864 00000100:00100000:3.0:1787388278.260492:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 148 00000100:00100000:3.0:1787388278.260503:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+12:14946:x1874211953044864:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388278.260522:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388278.260541:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef97400/0x5cb77467b1813143 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5151 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.260571:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef97400/0x5cb77467b1813143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5151 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.260582:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef97400/0x5cb77467b1813143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5151 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.260592:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97400, rc 0) 00000100:00100000:3.0:1787388278.260667:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:14946:x1874211953044864:12345-192.168.204.52@tcp:101:ll_cfg_requeue.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388278.260675:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 148 00000100:00100000:3.0:1787388278.262915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388278.263018:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953044992 00000100:00100000:0.0:1787388278.263028:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953044992 00000100:00100000:0.0:1787388278.263078:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 149 00000100:00100000:0.0:1787388278.263088:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:14946:x1874211953044992:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388278.263241:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:14946:x1874211953044992:12345-192.168.204.52@tcp:501:ll_cfg_requeue.0 Request processed in 154us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388278.263249:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 149 00000100:00100000:3.0:1787388278.265169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388278.265262:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953045120 00000100:00100000:0.0:1787388278.265273:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953045120 00000100:00100000:0.0:1787388278.265325:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 150 00000100:00100000:0.0:1787388278.265347:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:14946:x1874211953045120:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388278.265495:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:14946:x1874211953045120:12345-192.168.204.52@tcp:503:ll_cfg_requeue.0 Request processed in 149us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388278.265505:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 150 00000100:00100000:3.0:1787388278.280035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388278.280075:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971996672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388278.280176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388278.280223:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971996800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388278.280250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388278.280308:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996672 00000100:00100000:2.0:1787388278.280314:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996800 00000100:00100000:0.0:1787388278.280317:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996672 00000100:00100000:2.0:1787388278.280321:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996800 00000100:00100000:2.0:1787388278.280368:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787388278.280393:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971996800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388278.280434:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388278.280492:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874211971996800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.280498:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787388278.280520:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787388278.280526:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971996672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388278.280544:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388278.280558:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874211971996800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388278.280590:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211971996672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388278.280592:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273f5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211971996672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388278.280605:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787388278.344173:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787388278.473071:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787388278.473079:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9272c36c9000 from 13 10000000:01000000:3.0:1787388278.473084:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787388278.473136:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.473148:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.473160:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388278.473189:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971996928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.473270:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388278.473329:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c9bdc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.473724:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971996928 00000100:00100000:2.0:1787388278.473732:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971996928 00000100:00100000:2.0:1787388278.473845:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787388278.473855:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+20:17143:x1874211971996928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388278.473870:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388278.473885:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9272c3709a00/0x5cb77467b1813151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b181314a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.473915:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9272c3709a00/0x5cb77467b1813151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b181314a expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.473926:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9272c3709a00/0x5cb77467b1813151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b181314a expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.473936:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709a00, rc 0) 00000100:00100000:2.0:1787388278.473993:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971996928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.474008:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787388278.474078:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971996928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388278.474094:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1813151 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.474103:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b1813151 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388278.474169:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.474197:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388278.474228:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c9bdc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.475350:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997056 00000100:00100000:2.0:1787388278.475359:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997056 00000100:00100000:2.0:1787388278.475413:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787388278.475422:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971997056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.475574:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971997056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.475583:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388278.475740:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.475817:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.475861:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388278.475889:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c9bdc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.476017:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997184 00000100:00100000:2.0:1787388278.476022:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997184 00000100:00100000:2.0:1787388278.476055:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787388278.476063:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971997184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.476136:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971997184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.476143:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787388278.476217:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787388278.477229:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787388278.477561:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787388278.477583:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787388278.477594:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1813151 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.477606:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273eef96a00/0x5cb77467b181314a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b1813151 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388278.477618:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388278.477621:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273fbead800 from 13 10000000:01000000:2.0:1787388278.477865:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388278.477907:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.477925:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.477938:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388278.477965:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.478037:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388278.478117:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e7643600 going to sleep for 11 seconds 00000100:00100000:3.0:1787388278.484513:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997312 00000100:00100000:3.0:1787388278.484529:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997312 00000100:00100000:3.0:1787388278.484632:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787388278.484643:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+21:17143:x1874211971997312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388278.484660:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388278.484694:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef97200/0x5cb77467b181315f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1813158 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.484724:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef97200/0x5cb77467b181315f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1813158 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.484747:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef97200/0x5cb77467b181315f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1813158 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.484756:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97200, rc 0) 00000100:00100000:3.0:1787388278.485945:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971997312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1298us (7902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388278.485956:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787388278.486033:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388278.486067:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181315f expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388278.486079:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181315f expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388278.486162:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388278.486209:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388278.491797:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.499896:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997440 00000100:00100000:2.0:1787388278.499912:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997440 00000100:00100000:2.0:1787388278.499993:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787388278.500004:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971997440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.500174:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971997440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (13963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.500182:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787388278.500238:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.500287:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.500335:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388278.500356:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997568 00000100:00100000:2.0:1787388278.500359:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997568 00000100:00100000:2.0:1787388278.500374:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787388278.500379:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971997568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.500441:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971997568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.500456:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787388278.500491:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e7643b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.500502:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388278.502216:0:20248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787388278.502426:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787388278.502451:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388278.502463:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181315f expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388278.502475:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708200/0x5cb77467b1813158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181315f expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388278.502486:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787388278.502489:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9273c2f5e000 from 13 10000000:01000000:1.0:1787388278.502492:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388278.502532:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388278.502541:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388278.502550:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388278.502588:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388278.502643:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388278.502701:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388278.502767:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997696 00000100:00100000:3.0:1787388278.502852:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997696 00000100:00100000:3.0:1787388278.502892:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787388278.502900:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+22:17143:x1874211971997696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388278.502912:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388278.502926:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef96000/0x5cb77467b181316d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1813166 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.502948:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef96000/0x5cb77467b181316d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1813166 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.502959:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef96000/0x5cb77467b181316d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1813166 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.502968:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96000, rc 0) 00000100:00100000:3.0:1787388278.503022:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971997696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388278.503029:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787388278.503126:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388278.503140:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181316d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388278.503148:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181316d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388278.503197:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388278.503221:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388278.503240:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c4eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.503621:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997824 00000100:00100000:2.0:1787388278.503626:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997824 00000100:00100000:2.0:1787388278.503662:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787388278.503669:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971997824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.503809:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971997824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.503816:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787388278.503845:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.503871:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.503908:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388278.503926:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e7643480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388278.503935:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971997952 00000100:00100000:2.0:1787388278.503938:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971997952 00000100:00100000:2.0:1787388278.503953:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787388278.503958:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971997952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.504040:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971997952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388278.504047:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787388278.504084:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971997952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388278.504741:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787388278.508300:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787388278.508344:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388278.508364:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181316d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.508375:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9273d1020800/0x5cb77467b1813166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181316d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388278.508922:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388278.508927:0:17143:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff927401a55800 from 13 10000000:01000000:2.0:1787388278.508931:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388278.508984:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.508994:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.509006:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388278.509039:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971998080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.509108:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388278.509158:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e7643480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388278.510344:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998080 00000100:00100000:3.0:1787388278.510356:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998080 00000100:00100000:3.0:1787388278.510418:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787388278.510427:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+23:17143:x1874211971998080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388278.510444:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388278.510461:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9273eef97a00/0x5cb77467b181317b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5cb77467b1813174 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.510488:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9273eef97a00/0x5cb77467b181317b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5cb77467b1813174 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.510499:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9273eef97a00/0x5cb77467b181317b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5cb77467b1813174 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388278.510509:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97a00, rc 0) 00000100:00100000:3.0:1787388278.510562:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971998080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388278.510568:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787388278.511136:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971998080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388278.511154:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181317b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388278.511164:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5cb77467b181317b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388278.511233:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971998208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388278.511267:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388278.511299:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e7643480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388278.511343:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998208 00000100:00100000:0.0:1787388278.511349:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998208 00000100:00100000:0.0:1787388278.511386:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787388278.511393:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971998208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388278.511507:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971998208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388278.511515:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787388278.530163:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971998208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.530238:0:17143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971998336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388278.530321:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388278.530370:0:17143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c9bdc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787388278.530713:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998336 00000100:00100000:1.0:1787388278.530721:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998336 00000100:00100000:1.0:1787388278.530779:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787388278.530789:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273fbd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971998336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388278.530995:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273fbd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:17143:x1874211971998336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388278.531004:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787388278.531053:0:17143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3be7e40-7086-4e4f-aad1-8d3798e099a7:17143:1874211971998336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787388278.533474:0:20251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787388278.533714:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787388278.533738:0:17143:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388278.533752:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181317b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388278.533775:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.152@tcp lock: ffff9272c3708a00/0x5cb77467b1813174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5cb77467b181317b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388279.303885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971998592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388279.303899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971998464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388279.304160:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971998720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388279.305368:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971998848:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305444:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971998976:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305484:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971999488:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305518:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211972000000:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305558:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787388279.305563:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971999104:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971999616:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305669:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211972000128:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305742:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998976 00000100:00100000:0.0:1787388279.305749:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998976 00000100:00100000:3.0:1787388279.305781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305786:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999488 00000100:00100000:0.0:1787388279.305791:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999488 00000100:00100000:0.0:1787388279.305810:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388279.305827:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971999360:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305835:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971998976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.305855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388279.305875:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971999872:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305902:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971998976:12345-0@lo:400:kworker.0 Request processed in 83us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.305907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388279.305916:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388279.305933:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211972000384:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.305938:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787388279.305945:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971999488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.306427:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971999488:12345-0@lo:400:kworker.0 Request processed in 481us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388279.306435:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787388279.306462:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999104 00000100:00100000:0.0:1787388279.306466:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999104 00000100:00100000:0.0:1787388279.309031:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999616 00000100:00100000:0.0:1787388279.309057:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999616 00000100:00100000:0.0:1787388279.309119:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787388279.309130:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971999104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.309239:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971999104:12345-0@lo:400:kworker.0 Request processed in 110us (3654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388279.309246:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787388279.309264:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787388279.309283:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971999616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.309309:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211971999616:12345-0@lo:400:kworker.0 Request processed in 26us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388279.309314:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787388279.309345:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388279.309386:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971999104:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.309398:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971999616:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.309410:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971998976:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.309422:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211971999488:0@lo:400:kworker.0 00000100:00100000:0.0:1787388279.309476:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972000000 00000100:00100000:0.0:1787388279.309479:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972000000 00000100:00100000:0.0:1787388279.309522:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972000128 00000100:00100000:0.0:1787388279.309525:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972000128 00000100:00100000:0.0:1787388279.309535:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999360 00000100:00100000:0.0:1787388279.309538:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999360 00000100:00100000:0.0:1787388279.309547:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999872 00000100:00100000:0.0:1787388279.309549:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999872 00000100:00100000:0.0:1787388279.309559:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787388279.309564:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211972000000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.310823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388279.310887:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972000384 00000100:00100000:3.0:1787388279.310895:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972000384 00000100:00100000:3.0:1787388279.310932:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787388279.310941:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211972000128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311146:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874211972000128:12345-0@lo:400:kworker.0 Request processed in 205us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.311154:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787388279.311256:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388279.311267:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971999360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311309:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874211971999360:12345-0@lo:400:kworker.0 Request processed in 45us (5454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.311315:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388279.311329:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787388279.311334:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971999872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311361:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874211971999872:12345-0@lo:400:kworker.0 Request processed in 27us (5457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.311381:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787388279.311393:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388279.311399:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211972000384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311461:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874211972000384:12345-0@lo:400:kworker.0 Request processed in 61us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.311468:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388279.311489:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998848 00000100:00100000:3.0:1787388279.311494:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998848 00000100:00100000:3.0:1787388279.311525:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787388279.311531:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3645:x1874211971998848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311561:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3645:x1874211971998848:12345-0@lo:400:kworker.0 Request processed in 30us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.311567:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787388279.311625:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3645:1874211971998848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311639:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874211971999360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.311648:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874211971999872:0@lo:400:kworker.0 00010000:00080000:3.0:1787388279.311659:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6834a80 x1874211972000384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388279.311670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874211972000384:0@lo:400:kworker.0 00010000:00080000:3.0:1787388279.311729:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6836a00 x1874211972000128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388279.311739:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874211972000128:0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.312133:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998464 00000100:00100000:3.0:1787388279.312138:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998464 00000100:00100000:3.0:1787388279.312245:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787388279.312256:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971998464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388279.312343:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388279.312401:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874211971998464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (7012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.312408:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787388279.312426:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388279.312431:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388279.312457:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874211971998464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388279.318704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388279.318761:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971999232:0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.318842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388279.318891:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999232 00000100:00100000:2.0:1787388279.318900:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999232 00000100:00100000:2.0:1787388279.318980:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388279.318991:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971999232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319042:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971999232:12345-0@lo:400:kworker.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388279.319050:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787388279.319073:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388279.319107:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971999232:0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971999744:0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388279.319165:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211972000256:0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388279.319210:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972000256 00000100:00100000:2.0:1787388279.319214:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972000256 00000100:00100000:2.0:1787388279.319247:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787388279.319252:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211972000256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319282:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211972000256:12345-0@lo:400:kworker.0 Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388279.319288:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787388279.319306:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388279.319322:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211972000256:0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319373:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971999744 00000100:00100000:2.0:1787388279.319377:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971999744 00000100:00100000:2.0:1787388279.319406:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787388279.319421:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971999744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.319458:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211971999744:12345-0@lo:400:kworker.0 Request processed in 38us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388279.319465:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787388279.319477:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388279.319512:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211971999744:0@lo:400:kworker.0 00000100:00100000:3.0:1787388279.319712:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998720 00000100:00100000:3.0:1787388279.319716:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998720 00000100:00100000:3.0:1787388279.319750:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787388279.319758:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971998720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388279.319780:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787388279.319810:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273f5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211972000000:12345-0@lo:400:kworker.0 Request processed in 10242us (14265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388279.319821:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787388279.319827:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211971998720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.319834:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787388279.319863:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211972000000:0@lo:400:kworker.0 00000100:00100000:2.0:1787388279.320910:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211971998720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388279.324188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388279.326887:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211971998592 00000100:00100000:3.0:1787388279.326904:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211971998592 00000100:00100000:3.0:1787388279.326996:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787388279.327008:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971998592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388279.327036:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388279.327116:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211971998592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388279.327144:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388279.327526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211971998592:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787388279.367846:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388280.200585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.201234:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953045248 00000100:00100000:1.0:1787388280.201245:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953045248 00000100:00100000:1.0:1787388280.201323:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:1.0:1787388280.201335:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:15616:x1874211953045248:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388280.201356:0:19482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.201379:0:19482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1813182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5158 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201460:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201475:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201488:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201502:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201510:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201532:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201613:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021600/0x5cb77467b1813197 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201621:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021600/0x5cb77467b1813197 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201629:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021600/0x5cb77467b1813197 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.201665:0:19482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388280.201668:0:19482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388280.201739:0:19482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021600/0x5cb77467b1813197 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201752:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201758:0:19482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201764:0:19482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201770:0:19482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388280.201775:0:19482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201782:0:19482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201802:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:1.0:1787388280.201805:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388280.201809:0:19482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201816:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201830:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201836:0:19482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201840:0:19482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201845:0:19482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388280.201848:0:19482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201853:0:19482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201859:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9273d13c0300) 00010000:00010000:1.0:1787388280.201862:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388280.201865:0:19482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201870:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813190 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201916:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b1813182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5158 expref: 8 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201929:0:19482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021600/0x5cb77467b1813197 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5158 expref: 7 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.201948:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9273d13c0900) 00010000:00010000:1.0:1787388280.201950:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388280.201953:0:19482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021600, rc 0) 00000100:00100000:1.0:1787388280.202030:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15616:x1874211953045248:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 697us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388280.202038:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00080000:2.0:1787388280.202106:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388280.207212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388280.207979:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953045376 00000100:00100000:0.0:1787388280.207991:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953045376 00000100:00100000:0.0:1787388280.208076:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:0.0:1787388280.208085:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15616:x1874211953045376:12345-192.168.204.52@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787388280.208167:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15616:x1874211953045376:12345-192.168.204.52@tcp:900:lhsmtool_posix.0 Request processed in 83us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388280.208183:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:3.0:1787388280.215896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388280.215985:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953045632 00000100:00100000:2.0:1787388280.215995:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953045632 00000100:00100000:2.0:1787388280.216111:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:2.0:1787388280.216119:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15616:x1874211953045632:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388280.216140:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388280.216159:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b181319e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd515f expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216444:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216458:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216468:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216482:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216505:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216512:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216667:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b18131b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216794:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b18131b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216801:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b18131b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388280.216811:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787388280.216963:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216972:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216978:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216983:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388280.216988:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.216995:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217460:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9273d13c0900) 00010000:00010000:2.0:1787388280.217463:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388280.217468:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217475:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b18131a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217489:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217495:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217873:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217879:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388280.217883:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217889:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217897:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9273c2cb2600) 00010000:00010000:2.0:1787388280.217900:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388280.217903:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.217908:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b18131ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.225540:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b181319e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd515f expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.225585:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709200/0x5cb77467b18131b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd515f expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.225595:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273c2cb2300) 00010000:00010000:2.0:1787388280.225598:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388280.225601:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709200, rc 0) 00000100:00100000:2.0:1787388280.226096:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15616:x1874211953045632:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 9976us (10206us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787388280.226106:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:1.0:1787388280.269220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.269314:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953045760 00000100:00100000:3.0:1787388280.269325:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953045760 00000100:00100000:3.0:1787388280.269392:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:3.0:1787388280.269412:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15616:x1874211953045760:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787388280.269542:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15616:x1874211953045760:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.269550:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:0.0:1787388280.274880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.274993:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953045888 00000100:00100000:1.0:1787388280.275003:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953045888 00000100:00100000:1.0:1787388280.275087:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:1.0:1787388280.275101:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15616:x1874211953045888:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787388280.275411:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787388280.278201:0:17148:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3046us 00000100:00100000:3.0:1787388280.298593:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15616:x1874211953045888:12345-192.168.204.52@tcp:59:lhsmtool_posix.0 Request processed in 23488us (23717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.298609:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:2.0:1787388280.308825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.308915:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046016 00000100:00100000:3.0:1787388280.308925:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046016 00000100:00100000:3.0:1787388280.308988:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:3.0:1787388280.308996:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15622:x1874211953046016:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388280.309027:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388280.309050:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5166 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309115:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309130:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309163:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309327:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309336:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309344:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309462:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309470:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309477:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309482:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.309487:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309494:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309517:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:3.0:1787388280.309521:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.309526:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309608:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309625:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309632:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309638:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309643:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.309646:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309653:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309661:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9272c262d600) 00010000:00010000:3.0:1787388280.309664:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.309667:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.309674:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.312797:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5166 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.312837:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:3.0:1787388280.312840:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.312846:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5166 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.312858:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef97000, rc 0) 00000100:00100000:3.0:1787388280.312963:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15622:x1874211953046016:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 3965us (4147us total) trans 0 rc 301/301 00000100:00100000:3.0:1787388280.312972:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 27 00000100:00100000:2.0:1787388280.324149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388280.324552:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046144 00000100:00100000:0.0:1787388280.324562:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046144 00000100:00100000:0.0:1787388280.324620:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:0.0:1787388280.324630:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15622:x1874211953046144:12345-192.168.204.52@tcp:700:lfs.0 00000100:00100000:0.0:1787388280.324748:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15622:x1874211953046144:12345-192.168.204.52@tcp:700:lfs.0 Request processed in 119us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388280.324756:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:2.0:1787388280.334581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.335580:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046400 00000100:00100000:3.0:1787388280.335593:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046400 00000100:00100000:3.0:1787388280.335667:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 28 00000100:00100000:3.0:1787388280.335886:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:15622:x1874211953046400:12345-192.168.204.52@tcp:36:lfs.0 00010000:00010000:3.0:1787388280.335962:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388280.335996:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18130ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd50d3 expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.336017:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:3.0:1787388280.336023:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388280.336081:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.336098:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.336106:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.336161:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.336178:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 5 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388280.336195:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c209e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17146:1874211972000512:192.168.204.52@tcp:104: 00000100:00100000:3.0:1787388280.336341:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273c9bdc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787388280.361453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388280.367456:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046528 00000100:00100000:2.0:1787388280.367472:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046528 00010000:00010000:2.0:1787388280.367558:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 6 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388280.367603:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00100000:2.0:1787388280.367612:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2403:x1874211953046528:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388280.367627:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388280.367634:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 6 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.367668:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 6 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.367735:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:2.0:1787388280.367742:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.367754:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.367761:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.367784:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388280.367855:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:2403:x1874211953046528:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 243us (6413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388280.367863:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 15 00000100:00080000:0.0:1787388280.368084:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388280.369802:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181312e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5143 expref: 5 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388280.369833:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c209e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17146:1874211972000512:192.168.204.52@tcp:104: 00010000:00010000:3.0:1787388280.369857:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.369869:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.369875:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.369909:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.369922:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.369944:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.371884:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.371904:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.371914:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388280.371930:0:17146:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c901d4d reply state 00000000c3f2d883 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.371957:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.371964:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:3.0:1787388280.371968:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388280.371972:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787388280.371978:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388280.371986:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.371993:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372854:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372863:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef97000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.372867:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372887:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372898:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9273d13c0700) 00010000:00010000:3.0:1787388280.372902:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.372906:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372913:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388280.372945:0:17146:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c901d4d reply state 00000000c3f2d883 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372955:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.372961:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9272c262d600) 00010000:00010000:3.0:1787388280.372964:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388280.372966:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787388280.373262:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+10:15622:x1874211953046400:12345-192.168.204.52@tcp:36:lfs.0 Request processed in 37579us (38684us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787388280.373271:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 28 00010000:00010000:2.0:1787388280.393488:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388280.474976:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.476258:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046656 00000100:00100000:3.0:1787388280.476272:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046656 00000100:00100000:3.0:1787388280.476347:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:3.0:1787388280.476356:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+10:15630:x1874211953046656:12345-192.168.204.52@tcp:101:lctl.0 00010000:00010000:3.0:1787388280.476381:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388280.476404:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd516d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.476487:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96400/0x5cb77467b18131f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.476512:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96400/0x5cb77467b18131f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.476523:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96400/0x5cb77467b18131f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388280.476571:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388280.476575:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388280.476613:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96400/0x5cb77467b18131f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.476639:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b18131eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd516d expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.476660:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96400/0x5cb77467b18131f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd516d expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.476669:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:3.0:1787388280.476671:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388280.476675:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273eef96400, rc 0) 00000100:00100000:3.0:1787388280.476787:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+11:15630:x1874211953046656:12345-192.168.204.52@tcp:101:lctl.0 Request processed in 430us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.476794:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 29 00000100:00100000:2.0:1787388280.498302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.498626:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046784 00000100:00100000:1.0:1787388280.498637:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046784 00000100:00100000:1.0:1787388280.498735:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:1.0:1787388280.498747:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:15631:x1874211953046784:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388280.498772:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.498806:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18131f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5174 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.498879:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813200 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.498894:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.498905:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.498959:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388280.498963:0:17148:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388280.498988:0:17148:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.499013:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18131f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5174 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.499032:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020600/0x5cb77467b1813200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5174 expref: 6 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.499042:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:1.0:1787388280.499044:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388280.499048:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020600, rc 0) 00000100:00100000:1.0:1787388280.500134:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15631:x1874211953046784:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1381us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388280.500144:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 30 00000100:00100000:2.0:1787388280.509294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.509481:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953046912 00000100:00100000:3.0:1787388280.509492:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953046912 00000100:00100000:3.0:1787388280.509576:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:3.0:1787388280.509587:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+6:15631:x1874211953046912:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388280.509608:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388280.509628:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b1813207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd517b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509720:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509735:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509748:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509759:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509765:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509771:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509860:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340c600/0x5cb77467b181321c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509870:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340c600/0x5cb77467b181321c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509877:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340c600/0x5cb77467b181321c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388280.509924:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388280.509927:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388280.509963:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340c600/0x5cb77467b181321c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509978:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509985:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509991:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.509997:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0031600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.510002:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510009:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510023:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:3.0:1787388280.510025:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.510030:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510038:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0031600/0x5cb77467b181320e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510052:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510068:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510074:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510079:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c0030600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.510082:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510089:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510097:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9272c262d600) 00010000:00010000:3.0:1787388280.510100:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.510103:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510109:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c0030600/0x5cb77467b1813215 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510136:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef97000/0x5cb77467b1813207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd517b expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510150:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340c600/0x5cb77467b181321c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd517b expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.510157:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:3.0:1787388280.510160:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388280.510167:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c340c600, rc 0) 00000100:00100000:3.0:1787388280.510244:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+7:15631:x1874211953046912:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 659us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.510252:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 31 00000100:00100000:2.0:1787388280.515885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388280.516228:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953047040 00000100:00100000:0.0:1787388280.516238:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953047040 00000100:00100000:0.0:1787388280.516326:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:0.0:1787388280.516337:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:15631:x1874211953047040:12345-192.168.204.52@tcp:900:lfs.0 00000100:00100000:0.0:1787388280.516521:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:15631:x1874211953047040:12345-192.168.204.52@tcp:900:lfs.0 Request processed in 186us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388280.516529:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00080000:2.0:1787388280.516755:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388280.521656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388280.522088:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953047296 00000100:00100000:0.0:1787388280.522100:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953047296 00000100:00100000:0.0:1787388280.522221:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:0.0:1787388280.522232:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+7:15631:x1874211953047296:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:0.0:1787388280.522253:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388280.522297:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1813223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5182 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388280.523196:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787388280.523330:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1813223 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5182 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388280.523348:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:0.0:1787388280.523352:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388280.523357:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497000/0x5cb77467b1813223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5182 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388280.523375:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497000, rc 0) 00000100:00100000:0.0:1787388280.523532:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+8:15631:x1874211953047296:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1301us (1886us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787388280.523541:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 32 00000100:00100000:3.0:1787388280.533869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388280.534039:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953047552 00000100:00100000:2.0:1787388280.534051:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953047552 00000100:00100000:2.0:1787388280.534187:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:2.0:1787388280.534200:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+8:15631:x1874211953047552:12345-192.168.204.52@tcp:36:lfs.0 00010000:00010000:2.0:1787388280.534270:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388280.534322:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340c600/0x5cb77467b181321c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd517b expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.534344:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:2.0:1787388280.534349:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388280.534380:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.534396:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.534409:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388280.534748:0:17147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9560282 reply state 000000000f84035d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.534763:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.534769:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:2.0:1787388280.534772:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787388280.534776:0:17147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388280.534786:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787388280.534925:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+9:15631:x1874211953047552:12345-192.168.204.52@tcp:36:lfs.0 Request processed in 727us (1066us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787388280.534942:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 33 00000100:00100000:0.0:1787388280.540956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.541072:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953047808 00000100:00100000:3.0:1787388280.541083:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953047808 00000100:00100000:3.0:1787388280.541180:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:3.0:1787388280.541193:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+9:15631:x1874211953047808:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:3.0:1787388280.541459:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+10:15631:x1874211953047808:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 268us (528us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787388280.541468:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:0.0:1787388280.545411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.545557:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953048064 00000100:00100000:1.0:1787388280.545589:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953048064 00000100:00100000:1.0:1787388280.545652:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 34 00000100:00100000:1.0:1787388280.545663:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+10:15631:x1874211953048064:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388280.545790:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.545814:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5189 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.545915:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.545940:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.545953:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.545965:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.545973:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.545979:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.546106:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787388280.546187:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546196:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546213:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546220:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388280.546224:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546233:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546247:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:1.0:1787388280.546260:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388280.546265:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546272:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181323f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546285:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546291:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546297:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546301:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021800 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388280.546304:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546319:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546328:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9272c262d600) 00010000:00010000:1.0:1787388280.546331:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388280.546334:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546340:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b1813246 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546380:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813238 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5189 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546391:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:1.0:1787388280.546394:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388280.546401:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5189 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.546411:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021e00, rc 0) 00000100:00100000:1.0:1787388280.546539:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2623ffb6-be20-4c97-8a38-48065ab9eab6+11:15631:x1874211953048064:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 877us (1135us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787388280.546548:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 34 00000100:00100000:2.0:1787388280.552656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.552862:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953048192 00000100:00100000:1.0:1787388280.552871:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953048192 00000100:00100000:1.0:1787388280.552938:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:1.0:1787388280.552949:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+11:15631:x1874211953048192:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388280.552988:0:19482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.553010:0:19482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813254 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5190 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.553137:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.553150:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.553161:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.553186:0:19482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388280.553189:0:19482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388280.553208:0:19482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.553236:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813254 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 13 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.553254:0:19482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 12 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.553263:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:1.0:1787388280.553266:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388280.553270:0:19482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021800, rc 0) 00000100:00100000:1.0:1787388280.553331:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2623ffb6-be20-4c97-8a38-48065ab9eab6+12:15631:x1874211953048192:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 384us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388280.553338:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 35 00000100:00100000:0.0:1787388280.559595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388280.559715:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953048320 00000100:00100000:2.0:1787388280.559726:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953048320 00000100:00100000:2.0:1787388280.559791:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:2.0:1787388280.559816:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+12:15631:x1874211953048320:12345-192.168.204.52@tcp:37:lfs.0 00000100:00100000:2.0:1787388280.570420:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+12:15631:x1874211953048320:12345-192.168.204.52@tcp:37:lfs.0 Request processed in 10593us (10820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388280.570436:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 3 00000100:00100000:3.0:1787388280.574047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.574285:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953048576 00000100:00100000:1.0:1787388280.574297:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953048576 00000100:00100000:1.0:1787388280.574369:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:1.0:1787388280.574381:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+12:15631:x1874211953048576:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388280.574628:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+13:15631:x1874211953048576:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 248us (589us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787388280.574637:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 4 00000100:00100000:0.0:1787388280.633352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.633456:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953048704 00000100:00100000:3.0:1787388280.633467:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953048704 00000100:00100000:3.0:1787388280.633542:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:3.0:1787388280.633553:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+11:15637:x1874211953048704:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:3.0:1787388280.633577:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388280.633609:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5197 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633737:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633753:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633765:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633794:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633802:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633808:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633901:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d200/0x5cb77467b1813277 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633911:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d200/0x5cb77467b1813277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.633917:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d200/0x5cb77467b1813277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388280.634480:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388280.634486:0:17146:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388280.634531:0:17146:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d200/0x5cb77467b1813277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634545:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634552:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634559:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634575:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c340d400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.634580:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634588:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634657:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:3.0:1787388280.634661:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.634666:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634672:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d400/0x5cb77467b1813269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634705:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634712:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634717:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634722:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c340ca00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388280.634725:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634731:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634751:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9272c262d600) 00010000:00010000:3.0:1787388280.634754:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388280.634757:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634763:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813270 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634795:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5197 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634810:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340d200/0x5cb77467b1813277 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5197 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.634817:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:3.0:1787388280.634819:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787388280.634821:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c340d200, rc 0) 00000100:00100000:3.0:1787388280.635386:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+12:15637:x1874211953048704:12345-192.168.204.52@tcp:101:bash.0 Request processed in 1831us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.635398:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 36 00000100:00100000:0.0:1787388280.642526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.642809:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953048832 00000100:00100000:3.0:1787388280.642822:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953048832 00000100:00100000:3.0:1787388280.642893:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:3.0:1787388280.642905:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15637:x1874211953048832:12345-192.168.204.52@tcp:900:bash.0 00000100:00100000:3.0:1787388280.643145:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:15637:x1874211953048832:12345-192.168.204.52@tcp:900:bash.0 Request processed in 241us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.643155:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:2.0:1787388280.645359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.651613:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953049088 00000100:00100000:1.0:1787388280.651628:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953049088 00000100:00100000:1.0:1787388280.651707:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:1.0:1787388280.651717:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+12:15637:x1874211953049088:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:1.0:1787388280.651737:0:19482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.651759:0:19482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b181327e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd519e expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.651862:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.651877:0:19482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 12 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.651887:0:19482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.653122:0:19482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 12 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.653147:0:19482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 12 pid: 19482 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388280.653336:0:19482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19482:1874211972000640:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388280.653577:0:19482:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c2c9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388280.660527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.660626:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953049216 00000100:00100000:3.0:1787388280.660635:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953049216 00010000:00010000:3.0:1787388280.660673:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 13 pid: 19482 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388280.660747:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 16 00000100:00100000:3.0:1787388280.660759:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+13:2403:x1874211953049216:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388280.660774:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388280.660781:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 13 pid: 19482 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.660796:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 13 pid: 19482 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.660821:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:3.0:1787388280.660827:0:17131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.660837:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.660845:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.660872:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388280.660944:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2623ffb6-be20-4c97-8a38-48065ab9eab6+13:2403:x1874211953049216:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 186us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388280.660952:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 16 00010000:00010000:1.0:1787388280.661469:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b181325b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5190 expref: 12 pid: 19482 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388280.661490:0:19482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19482:1874211972000640:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388280.661513:0:19482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.661523:0:19482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.661529:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.661554:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.661564:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.661574:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662535:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662552:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662577:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.662589:0:19482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388280.662622:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662631:0:19482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662637:0:19482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662643:0:19482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388280.662647:0:19482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662654:0:19482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662664:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:1.0:1787388280.662667:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388280.662671:0:19482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662702:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b1813285 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388280.662715:0:19482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000853330fb reply state 00000000d4e7bfb6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662738:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662745:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9273d13c0300) 00010000:00010000:1.0:1787388280.662747:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388280.662751:0:19482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787388280.662789:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b181327e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 15 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662803:0:19482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 14 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.662809:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388280.662811:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787388280.662813:0:19482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020e00, rc 0) 00000100:00100000:1.0:1787388280.662871:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+15:15637:x1874211953049088:12345-192.168.204.52@tcp:101:bash.0 Request processed in 11155us (17523us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787388280.662879:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 37 00000100:00100000:0.0:1787388280.685902:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.686009:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953049344 00000100:00100000:1.0:1787388280.686021:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953049344 00000100:00100000:1.0:1787388280.686087:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 38 00000100:00100000:1.0:1787388280.686096:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+15:15637:x1874211953049344:12345-192.168.204.52@tcp:101:bash.0 00010000:00010000:1.0:1787388280.686119:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.686140:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51a5 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686213:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686238:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686248:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.686294:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787388280.686298:0:17148:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388280.686313:0:17148:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686322:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686344:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686360:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.686368:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388280.686371:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388280.686374:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020200, rc 0) 00000100:00100000:1.0:1787388280.686448:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+16:15637:x1874211953049344:12345-192.168.204.52@tcp:101:bash.0 Request processed in 348us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388280.686454:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 38 00000100:00100000:0.0:1787388280.691019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.691095:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953049600 00000100:00100000:1.0:1787388280.691105:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953049600 00000100:00100000:1.0:1787388280.691165:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 5 00000100:00100000:1.0:1787388280.691190:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+16:15637:x1874211953049600:12345-192.168.204.52@tcp:35:bash.0 00000100:00100000:1.0:1787388280.691508:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+17:15637:x1874211953049600:12345-192.168.204.52@tcp:35:bash.0 Request processed in 320us (499us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787388280.691517:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 5 00000040:00080000:1.0:1787388280.712347:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388280.783237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388280.783291:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953049856 00000100:00100000:3.0:1787388280.783315:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953049856 00000100:00100000:3.0:1787388280.783386:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 39 00000100:00100000:3.0:1787388280.783396:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+17:15647:x1874211953049856:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:3.0:1787388280.783422:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388280.783445:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b18132af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51ac expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388280.783615:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388280.783811:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b18132af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51ac expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.783827:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9272c262df00) 00010000:00010000:3.0:1787388280.783830:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388280.783835:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b18132af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51ac expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388280.783849:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c340cc00, rc 0) 00000100:00100000:3.0:1787388280.783915:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+18:15647:x1874211953049856:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 520us (685us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787388280.783922:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 39 00000100:00100000:3.0:1787388280.786015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.786130:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953050112 00000100:00100000:1.0:1787388280.786141:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953050112 00000100:00100000:1.0:1787388280.786196:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:1.0:1787388280.786205:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+18:15647:x1874211953050112:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:1.0:1787388280.786596:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+19:15647:x1874211953050112:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 389us (589us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787388280.786605:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 6 00000100:00100000:0.0:1787388280.822858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.824945:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953050368 00000100:00100000:1.0:1787388280.824959:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953050368 00000100:00100000:1.0:1787388280.825118:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:1.0:1787388280.825130:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+19:15650:x1874211953050368:12345-192.168.204.52@tcp:101:lfs.0 00010000:00010000:1.0:1787388280.825178:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388280.825211:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51b3 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.825330:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.825346:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.825357:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388280.825402:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388280.826248:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51b3 expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.826276:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51b3 expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.826286:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388280.826289:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388280.826293:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021800, rc 0) 00000100:00100000:1.0:1787388280.826383:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:15650:x1874211953050368:12345-192.168.204.52@tcp:101:lfs.0 Request processed in 1254us (3535us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787388280.826398:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 40 00000100:00100000:2.0:1787388280.834205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388280.834299:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953050496 00000100:00100000:1.0:1787388280.834310:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953050496 00000100:00100000:1.0:1787388280.834373:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:1.0:1787388280.834383:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:15650:x1874211953050496:12345-192.168.204.52@tcp:54:lfs.0 00010000:00010000:1.0:1787388280.834477:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834494:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834504:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834541:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834563:0:19482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834570:0:19482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834577:0:19482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1021e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388280.834582:0:19482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834589:0:19482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834602:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388280.834605:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388280.834610:0:19482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388280.834616:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388280.834758:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:15650:x1874211953050496:12345-192.168.204.52@tcp:54:lfs.0 Request processed in 376us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388280.834766:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 41 00000100:00100000:3.0:1787388280.836619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388280.836854:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953050624 00000100:00100000:2.0:1787388280.836865:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953050624 00000100:00100000:2.0:1787388280.836934:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:2.0:1787388280.836945:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:2404:x1874211953050624:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388280.836959:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388280.836983:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51b3 expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388280.837002:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:2.0:1787388280.837006:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388280.842369:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:2404:x1874211953050624:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 5414us (5747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388280.842385:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:3.0:1787388280.842866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388280.844261:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953050880 00000100:00100000:0.0:1787388280.844275:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953050880 00000100:00100000:0.0:1787388280.844372:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:0.0:1787388280.844407:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:15650:x1874211953050880:12345-192.168.204.52@tcp:35:lfs.0 00000100:00100000:0.0:1787388280.844896:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:15650:x1874211953050880:12345-192.168.204.52@tcp:35:lfs.0 Request processed in 490us (2031us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787388280.844904:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 7 00000100:00100000:1.0:1787388281.163643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388281.163744:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953051136 00000100:00100000:3.0:1787388281.163754:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953051136 00000100:00100000:3.0:1787388281.163815:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:3.0:1787388281.163824:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:15681:x1874211953051136:12345-192.168.204.52@tcp:101:cat.0 00010000:00010000:3.0:1787388281.163871:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388281.163893:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b18132d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51ba expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.164008:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b18132e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.164022:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b18132e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.164035:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b18132e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388281.164045:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787388281.164159:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b18132d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51ba expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.164176:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b18132e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51ba expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.164184:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:3.0:1787388281.164187:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388281.164191:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c340ca00, rc 0) 00000100:00100000:3.0:1787388281.164729:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:15681:x1874211953051136:12345-192.168.204.52@tcp:101:cat.0 Request processed in 902us (1092us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787388281.164737:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 42 00000100:00100000:3.0:1787388281.181793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.181937:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953051520 00000100:00100000:1.0:1787388281.181947:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953051520 00000100:00100000:1.0:1787388281.182050:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:1.0:1787388281.182060:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:15681:x1874211953051520:12345-192.168.204.52@tcp:35:cat.0 00000100:00100000:1.0:1787388281.182359:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+24:15681:x1874211953051520:12345-192.168.204.52@tcp:35:cat.0 Request processed in 299us (578us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787388281.182367:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 8 00000100:00100000:2.0:1787388281.188718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388281.188999:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953051264 00000100:00100000:3.0:1787388281.189010:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953051264 00000100:00100000:3.0:1787388281.189091:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:3.0:1787388281.189101:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+24:2404:x1874211953051264:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388281.189203:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388281.189231:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b18132e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51ba expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.189252:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:3.0:1787388281.189258:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388281.189323:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:2404:x1874211953051264:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 223us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388281.189332:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:2.0:1787388281.243755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.244733:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953051776 00000100:00100000:1.0:1787388281.244747:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953051776 00000100:00100000:1.0:1787388281.245299:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:1.0:1787388281.245314:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:15687:x1874211953051776:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:1.0:1787388281.245339:0:19482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388281.245358:0:19482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51c1 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.245462:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.245477:0:19482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 24 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.245486:0:19482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.245494:0:19482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.245530:0:19482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.245542:0:19482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 24 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388281.245575:0:19482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19482:1874211972000768:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388281.246261:0:19482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 24 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.246275:0:19482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 24 pid: 19482 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388281.246285:0:19482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19482:1874211972000896:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388281.246308:0:19482:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c349c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388281.263274:0:19482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19482:1874211972000896:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388281.263296:0:19482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19482:1874211972000768:192.168.204.52@tcp:104: 00010000:00010000:1.0:1787388281.263324:0:19482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.265416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.265468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388281.265560:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953051904 00000100:00100000:3.0:1787388281.265570:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953051904 00010000:00010000:3.0:1787388281.265610:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 25 pid: 19482 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388281.265653:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953052032 00000100:00100000:3.0:1787388281.265656:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953052032 00010000:00010000:3.0:1787388281.265669:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 26 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388281.265767:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:3.0:1787388281.265777:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+26:2403:x1874211953051904:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388281.265794:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388281.265801:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 26 pid: 19482 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.265830:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 26 pid: 19482 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.265865:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b1813293 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd519e expref: 26 pid: 19482 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.265886:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:3.0:1787388281.265892:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.265902:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.265909:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388281.265980:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+25:2403:x1874211953051904:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 204us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388281.265989:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:3.0:1787388281.266008:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:3.0:1787388281.266015:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c9f6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+24:2403:x1874211953052032:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388281.266024:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388281.266029:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 24 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.266041:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 24 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.266065:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18132a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51a5 expref: 24 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.266075:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:3.0:1787388281.266079:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.266087:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.266095:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.266118:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388281.266136:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c9f6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:2403:x1874211953052032:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 121us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388281.266144:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00010000:00010000:1.0:1787388281.267103:0:19482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.267115:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388281.267136:0:19482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388281.267288:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b18132ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c1 expref: 24 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.267307:0:19482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021800/0x5cb77467b18132f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c1 expref: 23 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.267324:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388281.267327:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388281.267330:0:19482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021800, rc 0) 00000100:00100000:1.0:1787388281.267654:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:15687:x1874211953051776:12345-192.168.204.52@tcp:101:dd.0 Request processed in 22344us (23913us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787388281.267662:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 43 00000100:00100000:2.0:1787388281.286799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.287104:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953052160 00000100:00100000:1.0:1787388281.287114:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953052160 00000100:00100000:1.0:1787388281.287181:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 44 00000100:00100000:1.0:1787388281.287192:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+23:15687:x1874211953052160:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:1.0:1787388281.287218:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388281.287241:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813303 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51c8 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.287280:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.287295:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.287307:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.287456:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813303 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 25 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.287476:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.287493:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388281.287496:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388281.287500:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020200, rc 0) 00000100:00100000:1.0:1787388281.287571:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+24:15687:x1874211953052160:12345-192.168.204.52@tcp:101:dd.0 Request processed in 381us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388281.287579:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 44 00000040:00080000:0.0:1787388281.292365:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388281.299751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388281.300150:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953052416 00000100:00100000:3.0:1787388281.300161:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953052416 00000100:00100000:3.0:1787388281.300275:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 45 00000100:00100000:3.0:1787388281.300287:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+24:15687:x1874211953052416:12345-192.168.204.52@tcp:36:dd.0 00010000:00010000:3.0:1787388281.300644:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.300663:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.300676:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388281.300776:0:17147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787388281.300799:0:17147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000821abee8 reply state 0000000020a0b138 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.300811:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.300819:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:3.0:1787388281.300822:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388281.300825:0:17147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388281.301103:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c34bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+27:15687:x1874211953052416:12345-192.168.204.52@tcp:36:dd.0 Request processed in 816us (1361us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787388281.301110:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 45 00000020:00080000:3.0:1787388281.301114:0:17147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388281.304315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.304482:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953052544 00000100:00100000:1.0:1787388281.304492:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953052544 00000100:00100000:1.0:1787388281.304551:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:1.0:1787388281.304561:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+27:15687:x1874211953052544:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:1.0:1787388281.304586:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388281.304608:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813318 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51cf expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.304671:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813318 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51cf expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.304841:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813318 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51cf expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.305341:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:0.0:1787388281.305354:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388281.305359:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1021e00, rc 0) 00000100:00100000:0.0:1787388281.305529:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15687:x1874211953052544:12345-192.168.204.52@tcp:101:dd.0 Request processed in 968us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.305538:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 46 00000100:00100000:3.0:1787388281.331066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.331149:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953052800 00000100:00100000:2.0:1787388281.331158:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953052800 00000100:00100000:2.0:1787388281.331536:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:2.0:1787388281.331547:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15687:x1874211953052800:12345-192.168.204.52@tcp:103:dd.0 00010000:00010000:2.0:1787388281.331565:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388281.331591:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1021e00/0x5cb77467b1813318 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51cf expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.331611:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:2.0:1787388281.331616:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388281.331730:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c209d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+27:15687:x1874211953052800:12345-192.168.204.52@tcp:103:dd.0 Request processed in 184us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.331738:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 2 00000100:00100000:2.0:1787388281.339337:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.341796:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953052928 00000100:00100000:1.0:1787388281.341810:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953052928 00000100:00100000:1.0:1787388281.341903:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:1.0:1787388281.341922:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+27:15687:x1874211953052928:12345-192.168.204.52@tcp:58:dd.0 00010000:00010000:1.0:1787388281.342032:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.342065:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.342077:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388281.347957:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388281.348301:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787388281.348480:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787388281.348590:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+27:15687:x1874211953052928:12345-192.168.204.52@tcp:58:dd.0 Request processed in 6672us (9257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388281.348603:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 47 00000100:00100000:2.0:1787388281.353120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388281.353226:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053056 00000100:00100000:3.0:1787388281.353237:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053056 00000100:00100000:3.0:1787388281.353359:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 48 00000100:00100000:3.0:1787388281.353370:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+27:15687:x1874211953053056:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:3.0:1787388281.353390:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388281.353410:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51d6 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.353464:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.353475:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 28 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.353513:0:17146:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.353526:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 28 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.353540:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:3.0:1787388281.353542:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388281.353546:0:17146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 28 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.353554:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c340cc00, rc 0) 00000100:00100000:3.0:1787388281.353609:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15687:x1874211953053056:12345-192.168.204.52@tcp:101:dd.0 Request processed in 242us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388281.353616:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 48 00010000:00010000:3.0:1787388281.416182:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388281.691644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388281.691865:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053184 00000100:00100000:3.0:1787388281.691874:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053184 00000100:00100000:3.0:1787388281.691946:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 164 00000100:00100000:3.0:1787388281.691956:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:2402:x1874211953053184:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:3.0:1787388281.692032:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:952f6066-6f96-4bdc-ad92-884b088ec3d7+13:2402:x1874211953053184:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 77us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388281.692040:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 164 00000100:00100000:1.0:1787388281.692746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.692782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.692809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.692878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.692901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.692951:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053696 00000100:00100000:2.0:1787388281.692958:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053696 00000100:00100000:2.0:1787388281.692993:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053312 00000100:00100000:2.0:1787388281.692996:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053312 00000100:00100000:2.0:1787388281.693016:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:2.0:1787388281.693024:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+12:2402:x1874211953053696:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388281.693073:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+12:2402:x1874211953053696:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.693080:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:2.0:1787388281.693094:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:2.0:1787388281.693101:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953053312:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:2.0:1787388281.693143:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953053312:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 42us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.693149:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:1.0:1787388281.696261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388281.696301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.700362:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053440 00000100:00100000:0.0:1787388281.700378:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053440 00000100:00100000:0.0:1787388281.700459:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053952 00000100:00100000:0.0:1787388281.700463:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053952 00000100:00100000:0.0:1787388281.700490:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053568 00000100:00100000:0.0:1787388281.700493:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053568 00000100:00100000:0.0:1787388281.700514:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:0.0:1787388281.700523:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953053440:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388281.700667:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953053440:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 144us (7923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.700676:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 17 00000100:00100000:0.0:1787388281.700713:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:0.0:1787388281.700719:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2402:x1874211953053952:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388281.700745:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2402:x1874211953053952:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 26us (7935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.700766:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 18 00000100:00100000:0.0:1787388281.700778:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:0.0:1787388281.700785:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953053568:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388281.700810:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2402:x1874211953053568:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 26us (7909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.700816:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00080000:0.0:1787388281.700842:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388281.700846:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388281.701012:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953053824 00000100:00100000:0.0:1787388281.701016:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953053824 00000100:00100000:0.0:1787388281.701047:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:0.0:1787388281.701053:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2402:x1874211953053824:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388281.701086:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2402:x1874211953053824:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 33us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.701092:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:0.0:1787388281.705392:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953054080 00000100:00100000:0.0:1787388281.705408:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953054080 00000100:00100000:0.0:1787388281.705487:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:0.0:1787388281.705497:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2402:x1874211953054080:12345-192.168.204.52@tcp:400:kworker.0 00000100:00100000:0.0:1787388281.705588:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2623ffb6-be20-4c97-8a38-48065ab9eab6+5:2402:x1874211953054080:12345-192.168.204.52@tcp:400:kworker.0 Request processed in 91us (9286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.705595:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00080000:1.0:1787388281.705780:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787388281.735875:0:17182:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787388281.735897:0:17182:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388281.735933:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787388281.735943:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787388281.736096:0:17182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c89180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17182:1874211972001024:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388281.736185:0:17182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c349c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388281.743171:0:17182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c89180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17182:1874211972001024:192.168.204.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388281.746475:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.746638:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953054208 00000100:00100000:2.0:1787388281.746648:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953054208 00000100:00100000:2.0:1787388281.746785:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:2.0:1787388281.746796:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15688:x1874211953054208:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388281.746829:0:17148:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388281.746960:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15688:x1874211953054208:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 165us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.746969:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 49 00000100:00100000:1.0:1787388281.749871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.749985:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953054336 00000100:00100000:0.0:1787388281.749994:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953054336 00000100:00100000:0.0:1787388281.750055:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:0.0:1787388281.750065:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15688:x1874211953054336:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.750149:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750168:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750181:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750198:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750205:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750211:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750234:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750244:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750251:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388281.750298:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787388281.750302:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388281.750317:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750336:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750342:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750349:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750355:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.750360:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750367:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750394:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273c2cb2300) 00010000:00010000:0.0:1787388281.750397:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.750402:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750419:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181332d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750434:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750440:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750446:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750458:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.750461:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750467:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750476:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9273c2b9c400) 00010000:00010000:0.0:1787388281.750478:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.750481:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750487:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813334 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750501:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750506:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750512:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750517:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.750520:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750526:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750543:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:0.0:1787388281.750545:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.750548:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.750554:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497200/0x5cb77467b181333b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.750636:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15688:x1874211953054336:12345-192.168.204.52@tcp:34:lhsmtool_posix.0 Request processed in 570us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.750644:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 50 00000100:00100000:0.0:1787388281.761011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.761088:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953054592 00000100:00100000:2.0:1787388281.761098:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953054592 00000100:00100000:2.0:1787388281.761164:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:2.0:1787388281.761176:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+28:15688:x1874211953054592:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388281.761198:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388281.761218:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813342 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51dd expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761354:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761371:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761384:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388281.761412:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787388281.761500:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761508:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761515:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761521:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:2.0:1787388281.761526:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761533:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761545:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:2.0:1787388281.761549:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388281.761553:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761559:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b1813349 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761603:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813342 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51dd expref: 30 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761613:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9273c2cb2300) 00010000:00010000:2.0:1787388281.761615:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388281.761625:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813342 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51dd expref: 30 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.761634:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709c00, rc 0) 00000100:00100000:2.0:1787388281.761742:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+29:15688:x1874211953054592:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 568us (743us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787388281.761751:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 51 00000100:00100000:1.0:1787388281.765783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.765963:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953054720 00000100:00100000:0.0:1787388281.765975:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953054720 00000100:00100000:0.0:1787388281.766037:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:0.0:1787388281.766048:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+29:15688:x1874211953054720:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388281.766087:0:17147:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388281.766218:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+29:15688:x1874211953054720:12345-192.168.204.52@tcp:53:lhsmtool_posix.0 Request processed in 170us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.766226:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 52 00000100:00100000:0.0:1787388281.778618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.778773:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953054976 00000100:00100000:2.0:1787388281.778783:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953054976 00000100:00100000:2.0:1787388281.778844:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:2.0:1787388281.778854:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+29:15688:x1874211953054976:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388281.778874:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388281.778895:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813357 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51e4 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388281.779264:0:17148:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1787388281.779272:0:17148:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787388281.779290:0:17148:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787388281.779443:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181335e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.779457:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181335e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.779467:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181335e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.779517:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813357 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51e4 expref: 32 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.779564:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181335e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51e4 expref: 31 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.779573:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2600) 00010000:00010000:2.0:1787388281.779576:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388281.779579:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709400, rc 0) 00000100:00100000:2.0:1787388281.779647:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+31:15688:x1874211953054976:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 794us (1037us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787388281.779655:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 53 00000100:00100000:1.0:1787388281.788065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.788165:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953055232 00000100:00100000:0.0:1787388281.788176:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953055232 00000100:00100000:0.0:1787388281.788238:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:0.0:1787388281.788249:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+31:15688:x1874211953055232:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.788308:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388281.788347:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181335e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51e4 expref: 31 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788368:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2600) 00010000:00010000:0.0:1787388281.788395:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388281.788810:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788825:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788835:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788853:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788861:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788868:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788929:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788937:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788944:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788950:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.788961:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788969:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788978:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:0.0:1787388281.788981:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.788985:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.788991:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b181336c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789001:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789007:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789012:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789017:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.789020:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789026:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789034:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf06afca2 (ffff9273c2b9c400) 00010000:00010000:0.0:1787388281.789037:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.789047:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.789052:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496e00/0x5cb77467b1813373 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf06afca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.789185:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+30:15688:x1874211953055232:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 937us (1129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388281.789194:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 54 00000100:00100000:0.0:1787388281.799133:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.799222:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953055360 00000100:00100000:2.0:1787388281.799234:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953055360 00000100:00100000:2.0:1787388281.799298:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:2.0:1787388281.799308:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+30:15688:x1874211953055360:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388281.799327:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388281.799348:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b181337a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51eb expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.799399:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1813381 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.799422:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1813381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.799433:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1813381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.799796:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b181337a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51eb expref: 32 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.799826:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3708000/0x5cb77467b1813381 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51eb expref: 31 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.799834:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:2.0:1787388281.799837:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388281.799840:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3708000, rc 0) 00000100:00100000:2.0:1787388281.799948:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+31:15688:x1874211953055360:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 641us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.799956:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 55 00000100:00100000:1.0:1787388281.810006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.810453:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953055616 00000100:00100000:2.0:1787388281.810466:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953055616 00000100:00100000:2.0:1787388281.810541:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:2.0:1787388281.810553:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+31:15688:x1874211953055616:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388281.810649:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.810666:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.810696:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388281.810870:0:17146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787388281.810880:0:17146:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 570795199991ns, next at 571795198020ns, rc = 0 00000004:00010000:2.0:1787388281.810938:0:17146:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016f01365 reply state 0000000027caab4b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.810971:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.810979:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:2.0:1787388281.810982:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388281.810986:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388281.811095:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+33:15688:x1874211953055616:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 543us (1101us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787388281.811103:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 56 00000100:00100000:0.0:1787388281.817227:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.820292:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953055744 00000100:00100000:2.0:1787388281.820313:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953055744 00000100:00100000:2.0:1787388281.820418:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:2.0:1787388281.820429:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+33:15688:x1874211953055744:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388281.820456:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388281.820492:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51f2 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.820551:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 34 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.820566:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 34 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.820595:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:2.0:1787388281.820598:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388281.820602:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9272c3709400, rc 0) 00000100:00100000:2.0:1787388281.820936:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+34:15688:x1874211953055744:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 254us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.820964:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 57 00000100:00100000:0.0:1787388281.823892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.824529:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953055872 00000100:00100000:2.0:1787388281.824543:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953055872 00000100:00100000:2.0:1787388281.824612:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:2.0:1787388281.824622:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2403:x1874211953055872:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787388281.824928:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2403:x1874211953055872:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 307us (1045us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787388281.824936:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:1.0:1787388281.849758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.849845:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953056128 00000100:00100000:0.0:1787388281.849857:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953056128 00000100:00100000:0.0:1787388281.849925:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:0.0:1787388281.849936:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+34:15688:x1874211953056128:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388281.850178:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+35:15688:x1874211953056128:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 242us (430us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787388281.850186:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 9 00000100:00100000:1.0:1787388281.856338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.856454:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953056384 00000100:00100000:0.0:1787388281.856466:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953056384 00000100:00100000:0.0:1787388281.856544:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:0.0:1787388281.856556:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+35:15688:x1874211953056384:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787388281.856750:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+35:15688:x1874211953056384:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 196us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.856759:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 58 00000100:00100000:2.0:1787388281.865175:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388281.865206:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211972001152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388281.865280:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388281.865375:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972001152 00000100:00100000:3.0:1787388281.865384:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972001152 00000100:00100000:3.0:1787388281.865459:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787388281.865496:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211972001152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388281.865523:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388281.865567:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211972001152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388281.865574:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787388281.865741:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388281.865776:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211972001152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388281.868930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.869191:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953056512 00000100:00100000:0.0:1787388281.869222:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953056512 00000100:00100000:0.0:1787388281.869284:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:0.0:1787388281.869295:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+35:15688:x1874211953056512:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.869319:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388281.869342:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1813396 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd51f9 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.869440:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b181339d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.869456:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b181339d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.869468:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b181339d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388281.869525:0:17148:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388281.869545:0:17148:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b181339d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.869582:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496200/0x5cb77467b1813396 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f9 expref: 37 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.869600:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b181339d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f9 expref: 36 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.869610:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:0.0:1787388281.869613:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787388281.869617:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1497e00, rc 0) 00000100:00100000:0.0:1787388281.869730:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+36:15688:x1874211953056512:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 437us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.869743:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 59 00000100:00100000:1.0:1787388281.874163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.874813:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953056640 00000100:00100000:0.0:1787388281.874829:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953056640 00000100:00100000:0.0:1787388281.875506:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:0.0:1787388281.875520:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2403:x1874211953056640:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.875546:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388281.875573:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5200 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388281.875596:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a896179, blocks: 0x0 00010000:00010000:0.0:1787388281.875615:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1787388281.875619:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388281.875628:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 7 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.875646:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 7 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.875660:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496200, rc 0) 00000100:00100000:0.0:1787388281.875765:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2403:x1874211953056640:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 248us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.875772:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:1.0:1787388281.882643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.882771:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953056896 00000100:00100000:0.0:1787388281.882784:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953056896 00000100:00100000:0.0:1787388281.882890:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:0.0:1787388281.882901:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+36:15688:x1874211953056896:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787388281.883053:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+36:15688:x1874211953056896:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 153us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.883063:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 60 00000100:00100000:3.0:1787388281.885768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.899295:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057024 00000100:00100000:2.0:1787388281.899310:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057024 00000100:00100000:2.0:1787388281.899394:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 61 00000100:00100000:2.0:1787388281.899406:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+36:15688:x1874211953057024:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787388281.910196:0:17126:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787388281.910225:0:17126:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787388281.910283:0:17126:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787388281.910467:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+19:15688:x1874211953057024:12345-192.168.204.52@tcp:44:lhsmtool_posix.0 Request processed in 11058us (24703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.910479:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 61 00010000:00010000:3.0:1787388281.910634:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.910647:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.910655:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.910661:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:3.0:1787388281.910666:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.910675:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.910720:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:3.0:1787388281.910724:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787388281.910729:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388281.910736:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709000/0x5cb77467b1813231 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388281.911042:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211972001280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787388281.911131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388281.911175:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972001280 00000100:00100000:3.0:1787388281.911184:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972001280 00000100:00100000:3.0:1787388281.911239:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388281.911249:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211972001280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787388281.911380:0:18653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787388281.911383:0:18653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787388281.911386:0:18653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787388281.911388:0:18653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787388281 -> 1787388281 00002000:00010000:3.0:1787388281.911390:0:18653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1787388281.911512:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911521:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911528:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911534:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.911536:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911554:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911565:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9272c262d600) 00010000:00010000:0.0:1787388281.911568:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.911572:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911578:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96600/0x5cb77467b18131dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911596:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911601:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911613:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911618:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273eef96200 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.911621:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911627:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911648:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9272c262d700) 00010000:00010000:0.0:1787388281.911651:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.911655:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911661:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273eef96200/0x5cb77467b18131e4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911676:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911715:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911720:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911726:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020400 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.911728:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911746:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911756:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9273d13c0300) 00010000:00010000:0.0:1787388281.911758:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.911761:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911768:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b181328c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911786:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911793:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911799:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911804:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c340ca00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.911807:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911813:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911821:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:0.0:1787388281.911824:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388281.911827:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911839:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340ca00/0x5cb77467b1813311 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911853:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911859:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911865:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911871:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388281.911874:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911880:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911890:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:0.0:1787388281.911892:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787388281.911895:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.911901:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709c00/0x5cb77467b1813388 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787388281.912389:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388281.913538:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874211972001280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2285us (2401us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787388281.913550:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1787388281.913822:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9272c3c88700/2, rc 0, transno 8589934596 00000100:00100000:2.0:1787388281.913832:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211972001280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787388281.917231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.919529:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057152 00000100:00100000:0.0:1787388281.919544:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057152 00000100:00100000:0.0:1787388281.919608:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:0.0:1787388281.919619:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c3788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2402:x1874211953057152:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787388281.919771:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c3788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2402:x1874211953057152:12345-192.168.204.52@tcp:16:lhsmtool_posix.0 Request processed in 153us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.919779:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 23 00000100:00100000:3.0:1787388281.922598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.922821:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057408 00000100:00100000:0.0:1787388281.922831:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057408 00000100:00100000:0.0:1787388281.922893:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:0.0:1787388281.922913:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+15:15688:x1874211953057408:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.922964:0:19482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388281.923001:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497e00/0x5cb77467b181339d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f9 expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.923020:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:0.0:1787388281.923025:0:19482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388281.923061:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b18133ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.923075:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b18133ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.923085:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b18133ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388281.923229:0:19482:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000751321c4 reply state 00000000d1005b4a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b18133ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.923242:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496800/0x5cb77467b18133ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.923248:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:0.0:1787388281.923266:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388281.923269:0:19482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388281.923378:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+16:15688:x1874211953057408:12345-192.168.204.52@tcp:36:lhsmtool_posix.0 Request processed in 475us (789us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787388281.923386:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 62 00000100:00100000:3.0:1787388281.926943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.927141:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057536 00000100:00100000:0.0:1787388281.927151:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057536 00000100:00100000:0.0:1787388281.927217:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:0.0:1787388281.927232:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:15688:x1874211953057536:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.927254:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388281.927274:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd5207 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.927306:0:18652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.927315:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388281.927320:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388281.927326:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.927367:0:18652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.927383:0:18652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.927419:0:18652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18652:1874211972001408:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388281.927514:0:18652:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273cbabd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388281.930557:0:18652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18652:1874211972001408:192.168.204.52@tcp:104: 00000100:00100000:1.0:1787388281.930558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00010000:00010000:0.0:1787388281.930592:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.930613:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273c1496000, rc 0) 00000100:00100000:0.0:1787388281.930714:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+8:15688:x1874211953057536:12345-192.168.204.52@tcp:101:lhsmtool_posix.0 Request processed in 3486us (3780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.930722:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 24 00000100:00100000:2.0:1787388281.930803:0:19484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057664 00000100:00100000:2.0:1787388281.930811:0:19484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057664 00010000:00010000:2.0:1787388281.930845:0:19484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.930880:0:19484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:2.0:1787388281.930889:0:19484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+8:2404:x1874211953057664:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388281.930913:0:19484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388281.930934:0:19484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.930947:0:19484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.930982:0:19484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039fd342b/0x5cb77467b18133a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5200 expref: 8 pid: 18652 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.930997:0:19484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388281.931000:0:19484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388281.931007:0:19484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 7 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.931016:0:19484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 7 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.931072:0:19484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 7 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.931085:0:19484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3dbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:19484:1874211972001536:192.168.204.52@tcp:105: 00000100:00100000:2.0:1787388281.931148:0:19484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273e76436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388281.934259:0:19484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3dbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:19484:1874211972001536:192.168.204.52@tcp:105: 00010000:00010000:2.0:1787388281.934285:0:19484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388281.934338:0:19484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2404:x1874211953057664:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 3448us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.934350:0:19484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 19 00000100:00100000:3.0:1787388281.934567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.938079:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057792 00000100:00100000:0.0:1787388281.938098:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057792 00000100:00100000:1.0:1787388281.946497:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:1.0:1787388281.946512:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2403:x1874211953057792:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787388281.946708:0:18653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787388281.946712:0:18653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787388281 00002000:00010000:1.0:1787388281.946715:0:18653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787388280 00002000:00010000:1.0:1787388281.946718:0:18653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787388281 -> 1787388281 00002000:00010000:1.0:1787388281.946720:0:18653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787388281.946796:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+8:2403:x1874211953057792:12345-192.168.204.52@tcp:2:lhsmtool_posix.0 Request processed in 286us (12229us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787388281.946804:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 25 00000100:00100000:1.0:1787388281.951389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.952772:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953057920 00000100:00100000:0.0:1787388281.952789:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953057920 00000100:00100000:0.0:1787388281.952861:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:0.0:1787388281.952871:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+8:2402:x1874211953057920:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.952927:0:19659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.952947:0:19659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.952956:0:19659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388281.952960:0:19659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388281.953104:0:19659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.953146:0:19659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.953161:0:19659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 8 pid: 18652 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.953176:0:19659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19659:1874211972001664:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388281.953274:0:19659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273cbabd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388281.959554:0:19659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19659:1874211972001664:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388281.959586:0:19659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388281.964511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.964747:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953058048 00000100:00100000:0.0:1787388281.964758:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953058048 00010000:00010000:0.0:1787388281.964800:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 9 pid: 18652 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.964848:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 20 00000100:00100000:0.0:1787388281.964859:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+9:2404:x1874211953058048:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388281.964873:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388281.964894:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 9 pid: 18652 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.964937:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 9 pid: 18652 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.964961:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b828eb/0x5cb77467b18133b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd5207 expref: 9 pid: 18652 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.964987:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388281.964992:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388281.964998:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.965008:0:17132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.965042:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388281.965099:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2406629b-ad3b-4a21-a5a1-6f470adb1172+8:2404:x1874211953058048:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 241us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.965108:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 20 00010000:00010000:2.0:1787388281.965672:0:19659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965716:0:19659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965740:0:19659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965748:0:19659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965756:0:19659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965776:0:19659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497e00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388281.965781:0:19659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965790:0:19659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965803:0:19659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.965810:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a46931/0x5cb77467b18133b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.965880:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2406629b-ad3b-4a21-a5a1-6f470adb1172+7:2402:x1874211953057920:12345-192.168.204.52@tcp:1:lhsmtool_posix.0 Request processed in 13009us (14512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.965888:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 26 00000100:00100000:1.0:1787388281.979831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.979924:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953058304 00000100:00100000:0.0:1787388281.979935:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953058304 00000100:00100000:0.0:1787388281.980005:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 63 00000100:00100000:0.0:1787388281.980015:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+16:15688:x1874211953058304:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787388281.980098:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.980131:0:17148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.980141:0:17148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.980172:0:17148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.980185:0:17148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 16 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.980201:0:17148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1874211972001792:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388281.980282:0:17148:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273cbabd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388281.985285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388281.985406:0:17148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1874211972001792:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388281.985434:0:17148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388281.985545:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953058432 00000100:00100000:3.0:1787388281.985554:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953058432 00010000:00010000:3.0:1787388281.985601:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.985899:0:19484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 21 00000100:00100000:2.0:1787388281.985923:0:19484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+17:2404:x1874211953058432:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388281.985941:0:19484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388281.985949:0:19484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.985963:0:19484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.986004:0:19484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b181330a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51c8 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.986021:0:19484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:2.0:1787388281.986027:0:19484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.986037:0:19484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.986044:0:19484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.986052:0:19484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.986082:0:19484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388281.986137:0:19484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+16:2404:x1874211953058432:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 218us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.986146:0:19484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 21 00010000:00010000:0.0:1787388281.986210:0:17148:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.986218:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.986441:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.986454:0:17148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.986469:0:17148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.986498:0:17148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388281.986511:0:17148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 16 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388281.986524:0:17148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1874211972001920:192.168.204.52@tcp:104: 00000100:00100000:0.0:1787388281.986589:0:17148:0:(client.c:2702:ptlrpc_set_wait()) set ffff9273f5e1aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388281.991459:0:17148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1874211972001920:192.168.204.52@tcp:104: 00010000:00010000:0.0:1787388281.991501:0:17148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388281.994075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388281.994198:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953058560 00000100:00100000:2.0:1787388281.994208:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953058560 00010000:00010000:2.0:1787388281.994247:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.994294:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 22 00000100:00100000:2.0:1787388281.994304:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+17:2401:x1874211953058560:12345-192.168.204.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388281.994334:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388281.994341:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.994356:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.994378:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9272c3709400/0x5cb77467b181338f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51f2 expref: 17 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.994394:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:2.0:1787388281.994399:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.994408:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.994415:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388281.994450:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388281.994496:0:17148:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.994514:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388281.994516:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c4469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+16:2401:x1874211953058560:12345-192.168.204.52@tcp:103:ldlm_bl.0 Request processed in 213us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388281.994524:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 22 00000001:00080000:1.0:1787388281.994650:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787388281.994804:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787388281.994839:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787388281.994921:0:17148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17148:1874211972002048:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787388281.994968:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388281.995000:0:17148:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c349c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787388281.995020:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002048 00000100:00100000:0.0:1787388281.995025:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002048 00000100:00100000:0.0:1787388281.995067:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787388281.995074:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17148:x1874211972002048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787388281.995156:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17148:x1874211972002048:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388281.995163:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787388281.995374:0:17148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17148:1874211972002048:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787388281.995731:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787388281.995782:0:17148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17148:1874211972002176:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787388281.995813:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388281.995827:0:17148:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c349c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388281.995877:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002176 00000100:00100000:0.0:1787388281.995882:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002176 00000100:00100000:0.0:1787388281.995965:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787388281.995974:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17148:x1874211972002176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787388281.996094:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17148:x1874211972002176:12345-0@lo:1000:mdt00_002.0 Request processed in 117us (275us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787388281.996101:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787388281.996123:0:17148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17148:1874211972002176:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787388281.996151:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996160:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996167:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996173:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497600 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388281.996177:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996194:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996208:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:1.0:1787388281.996211:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388281.996216:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996222:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497600/0x5cb77467b18133c7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996251:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996258:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996263:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996268:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273d1020e00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:1.0:1787388281.996271:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996277:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996285:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388281.996287:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388281.996293:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996316:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996323:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388281.996384:0:17148:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9273c340cc00/0x5cb77467b1813326 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd51d6 expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388281.996397:0:17148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1874211972002304:192.168.204.52@tcp:105: 00000100:00100000:1.0:1787388281.996463:0:17148:0:(client.c:2702:ptlrpc_set_wait()) set ffff9272c349c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787388282.000342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388282.000425:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953058688 00000100:00100000:2.0:1787388282.000434:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953058688 00000100:00100000:2.0:1787388282.000484:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:2.0:1787388282.000494:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3cb1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:15687:x1874211953058688:12345-192.168.204.52@tcp:49:dd.0 00000100:00100000:2.0:1787388282.000654:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3cb1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:15687:x1874211953058688:12345-192.168.204.52@tcp:49:dd.0 Request processed in 161us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388282.000663:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 10 00000100:00100000:3.0:1787388282.003626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:1.0:1787388282.003800:0:19482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953058816 00000100:00100000:1.0:1787388282.003808:0:19482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953058816 00000100:00100000:0.0:1787388282.003826:0:17148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1874211972002304:192.168.204.52@tcp:105: 00010000:00010000:0.0:1787388282.003861:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.003874:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020e00/0x5cb77467b181331f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388282.003896:0:19482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:1.0:1787388282.003918:0:19482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:15687:x1874211953058816:12345-192.168.204.52@tcp:101:dd.0 00010000:00010000:1.0:1787388282.003936:0:19482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388282.003950:0:19482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b18133ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbceedb20d7fd520e expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.003979:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.003992:0:19482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004000:0:19482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004020:0:19482:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004029:0:19482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787388282.004082:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787388282.004123:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004134:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004145:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004155:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004162:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004168:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004238:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496c00 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388282.004244:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004263:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004276:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:0.0:1787388282.004279:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388282.004283:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004289:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496c00/0x5cb77467b18133dc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004299:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004304:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004311:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004315:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1496000 already unused, calling callback (ffffffffc18614f0) 00010000:00010000:0.0:1787388282.004318:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004323:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004330:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:0.0:1787388282.004333:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388282.004335:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004354:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004359:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004457:0:19482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004459:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004475:0:19482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.004476:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1496000/0x5cb77467b18133c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004598:0:19482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020400/0x5cb77467b18133ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd520e expref: 22 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004614:0:19482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9273d1020200/0x5cb77467b18133d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.52@tcp remote: 0xbceedb20d7fd520e expref: 21 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388282.004622:0:19482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9273d13c0e00) 00010000:00010000:1.0:1787388282.004625:0:19482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388282.004627:0:19482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9273d1020200, rc 0) 00000100:00100000:0.0:1787388282.004663:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2406629b-ad3b-4a21-a5a1-6f470adb1172+21:15688:x1874211953058304:12345-192.168.204.52@tcp:57:lhsmtool_posix.0 Request processed in 24648us (24839us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787388282.004674:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 63 00000020:00080000:0.0:1787388282.004699:0:17148:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787388282.005048:0:17182:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787388282.005053:0:17182:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388282.005071:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787388282.005077:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787388282.005550:0:19482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:15687:x1874211953058816:12345-192.168.204.52@tcp:101:dd.0 Request processed in 1631us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388282.005558:0:19482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 64 00000100:00100000:3.0:1787388282.010016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:0.0:1787388282.010196:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953059072 00000100:00100000:0.0:1787388282.010216:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953059072 00000100:00100000:0.0:1787388282.010272:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 11 00000100:00100000:0.0:1787388282.010283:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+20:15688:x1874211953059072:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787388282.011121:0:17149:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787388282.011157:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787388282.011193:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.011222:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.011233:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.011259:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.011265:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.011270:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388282.011295:0:17149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787388282.011845:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+22:15688:x1874211953059072:12345-192.168.204.52@tcp:35:lhsmtool_posix.0 Request processed in 1120us (1397us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787388282.011855:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 11 00000020:00080000:0.0:1787388282.011860:0:17149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787388282.011944:0:20175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388282.011952:0:20175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388282.011960:0:20175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9273c1497c00 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:3.0:1787388282.011972:0:20175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388282.011980:0:20175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388282.011994:0:20175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9273c2cb2400) 00010000:00010000:3.0:1787388282.011998:0:20175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787388282.012002:0:20175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388282.012008:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9273c1497c00/0x5cb77467b18133e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388282.012020:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388282.012022:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388282.012023:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388282.215782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:3.0:1787388282.215828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.52@tcp (source: 12345-192.168.204.52@tcp) 00000100:00100000:2.0:1787388282.216021:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953059200 00000100:00100000:2.0:1787388282.216031:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953059200 00000100:00100000:2.0:1787388282.216101:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211953059328 00000100:00100000:2.0:1787388282.216104:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211953059328 00000100:00100000:2.0:1787388282.216126:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:2.0:1787388282.216134:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+8:2403:x1874211953059200:12345-192.168.204.52@tcp:4:dd.0 00002000:00010000:2.0:1787388282.216198:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a896179, atime: 0x6a896178, ctime: 0x6a896179, blocks: 0x0 00010000:00010000:2.0:1787388282.216208:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.216225:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1787388282.216230:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388282.216236:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.216252:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388282.316122:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1787388282.316143:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1787388282.316516:0:18657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787388282.316650:0:18657:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787388281 -> 1787388282 00002000:00010000:2.0:1787388282.316653:0:18657:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787388281 -> 1787388282 00002000:00010000:2.0:1787388282.316656:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1787388282.316676:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.316709:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.316790:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.316798:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709400 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388282.316805:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.316815:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.316838:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.316846:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003967e77f/0x5cb77467b18133ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388282.316981:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+6:2403:x1874211953059200:12345-192.168.204.52@tcp:4:dd.0 Request processed in 100841us (101204us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787388282.316996:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 0 00000100:00100000:2.0:1787388282.317036:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.52@tcp, seq: 1 00000100:00100000:2.0:1787388282.317049:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2403:x1874211953059328:12345-192.168.204.52@tcp:4:dd.0 00002000:00010000:2.0:1787388282.317090:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a89617a, atime: 0x6a896178, ctime: 0x6a89617a, blocks: 0x2000 00010000:00010000:2.0:1787388282.317097:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.317115:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1787388282.317120:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388282.317126:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.317138:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388282.390131:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1787388282.391473:0:18657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1787388282.391482:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1787388282.391498:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.391511:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.391519:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.391526:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9272c3709000 already unused, calling callback (ffffffffc0c57e90) 00010000:00010000:2.0:1787388282.391531:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.391567:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.391593:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388282.391602:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a346a4/0x5cb77467b18133f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388282.392090:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2406629b-ad3b-4a21-a5a1-6f470adb1172+5:2403:x1874211953059328:12345-192.168.204.52@tcp:4:dd.0 Request processed in 75039us (176254us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787388282.392101:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.52@tcp, seq: 1 00010000:00010000:2.0:1787388282.440328:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388283.399852:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388283.399969:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211972002432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388283.400039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388283.400155:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002432 00000100:00100000:3.0:1787388283.400164:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002432 00000100:00100000:3.0:1787388283.400210:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787388283.400218:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211972002432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388283.400253:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388283.400297:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874211972002432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388283.400304:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388283.401034:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388283.401519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874211972002432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388283.401763:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211972002560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388283.401830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388283.403149:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002560 00000100:00100000:0.0:1787388283.403164:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002560 00000100:00100000:0.0:1787388283.403232:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388283.403242:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211972002560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388283.403281:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787388283.403622:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211972002560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 380us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388283.403631:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388283.403782:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211972002560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388283.467389:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388284.010657:0:20325:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:3.0:1787388284.362296:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388284.423876:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787388284.423899:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211972002816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388284.423966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424015:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211972002688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388284.424037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211972002944:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388284.424121:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211972003328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424130:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211972003456:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388284.424151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424165:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211972003968:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424166:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211972003840:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424194:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002816 00000100:00100000:2.0:1787388284.424201:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002816 00000100:00100000:1.0:1787388284.424213:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003328 00000100:00100000:1.0:1787388284.424217:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003328 00000100:00100000:2.0:1787388284.424241:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002688 00000100:00100000:2.0:1787388284.424244:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002688 00000100:00100000:1.0:1787388284.424247:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787388284.424255:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211972003328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424258:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388284.424263:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211972002816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388284.424285:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787388284.424304:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874211972003328:12345-0@lo:400:kworker.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388284.424311:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787388284.424313:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211972002816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388284.424318:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388284.424327:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388284.424333:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211972002688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388284.424346:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787388284.424351:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211972003328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424369:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874211972002688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388284.424374:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787388284.424387:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388284.424388:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003840 00000100:00080000:2.0:1787388284.424391:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388284.424391:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003840 00000100:00100000:2.0:1787388284.424399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388284.424418:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003968 00000100:00100000:1.0:1787388284.424421:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003968 00000100:00100000:2.0:1787388284.424425:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211972002816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388284.424433:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1787388284.424438:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9272c3c88700, transno 8589934596 00000100:00100000:1.0:1787388284.424439:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787388284.424445:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211972003840:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1787388284.424448:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1787388284.424467:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874211972002688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388284.424478:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874211972003840:12345-0@lo:400:kworker.0 Request processed in 34us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388284.424484:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787388284.424496:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787388284.424502:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211972003968:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787388284.424617:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388284.424620:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787388284.424637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6863b80 x1874211972003968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388284.424648:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874211972003968:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424700:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874211972003968:12345-0@lo:400:kworker.0 Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388284.424701:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c446a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211972003072:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424715:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388284.424725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388284.424733:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211972004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388284.424741:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211972003584:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388284.424756:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424770:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211972004096:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424777:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874211972003840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388284.424797:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003456 00000100:00100000:1.0:1787388284.424800:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003456 00000100:00100000:2.0:1787388284.424806:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787388284.424812:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211972003200:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424827:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003584 00000100:00100000:1.0:1787388284.424830:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003584 00000100:00100000:2.0:1787388284.424832:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424846:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211972003712:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.424849:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787388284.424870:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211972003456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424890:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9273c6863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211972004224:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.424909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388284.424929:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972002944 00000100:00100000:2.0:1787388284.424933:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972002944 00000100:00100000:3.0:1787388284.424938:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972004352 00000100:00100000:3.0:1787388284.424941:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972004352 00000100:00100000:3.0:1787388284.424958:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388284.424958:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787388284.424965:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273c6861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211972004352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388284.424965:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9273cbaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3647:x1874211972002944:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787388284.424976:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388284.425029:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273c6861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874211972004352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425035:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388284.425057:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972004096 00000100:00100000:3.0:1787388284.425060:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972004096 00000100:00100000:3.0:1787388284.425077:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003200 00000100:00100000:3.0:1787388284.425079:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003200 00000100:00100000:3.0:1787388284.425090:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003712 00000100:00100000:3.0:1787388284.425092:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003712 00000100:00100000:3.0:1787388284.425100:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972004224 00000100:00100000:3.0:1787388284.425102:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972004224 00000100:00100000:3.0:1787388284.425113:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388284.425119:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211972004096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425152:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874211972004096:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425158:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388284.425170:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388284.425175:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211972003200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425200:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874211972003200:12345-0@lo:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425206:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388284.425229:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787388284.425234:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211972003712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425262:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874211972003712:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425268:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787388284.425277:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388284.425283:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211972004224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425305:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874211972004224:12345-0@lo:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425310:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388284.425342:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c3cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874211972004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388284.425365:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273ffa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874211972003200:0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425373:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874211972003712:0@lo:400:kworker.0 00010000:00080000:3.0:1787388284.425383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9273c6863480 x1874211972004224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388284.425392:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874211972004224:0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425405:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874211972004096:0@lo:400:kworker.0 00000100:00080000:3.0:1787388284.425448:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388284.425452:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388284.425454:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388284.425456:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388284.425463:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211972003072 00000100:00100000:3.0:1787388284.425467:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211972003072 00000100:00100000:3.0:1787388284.425490:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388284.425496:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211972003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425536:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874211972003072:12345-0@lo:400:kworker.0 Request processed in 41us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425543:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388284.425588:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c446a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874211972003072:0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425617:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388284.425625:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9272c3db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211972003584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.425657:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874211972003584:12345-0@lo:400:kworker.0 Request processed in 33us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388284.425662:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388284.425713:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874211972003584:0@lo:400:kworker.0 00000100:00100000:3.0:1787388284.428760:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9273c6863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874211972003456:0@lo:400:kworker.0 00000100:00100000:1.0:1787388284.429007:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9272c3db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874211972003456:12345-0@lo:400:kworker.0 Request processed in 4150us (4853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388284.429020:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787388284.433459:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9272c4469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3be7e40-7086-4e4f-aad1-8d3798e099a7:3647:1874211972002944:0@lo:400:kworker.0 00000100:00100000:2.0:1787388284.433460:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9273cbaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3be7e40-7086-4e4f-aad1-8d3798e099a7+24:3647:x1874211972002944:12345-0@lo:400:kworker.0 Request processed in 8485us (9362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388284.433492:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00010000:3.0:1787388284.489073:0:20175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388285.513763:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42215 lines, 42215 kept, 0 dropped, 0 bad.